The whole idea of "marriage" is a states' rights issue and has no business at the fed level. Tenth Amendment, anybody?
So yes, I have a problem with spending taxpayer dollars on moral/societal issues.
But hell, Congress doesn't give a shit about the 10th Amendment and certainly feels empowered to do all manner of things that they shouldn't be doing.