As long as the government is giving exclusive benefits to married couples then, yes, being anti-same-sex-marriage is at least a little anti-gay.

It didn't have to be this way. I wish the government would get out of marriage all together. Edit: civil unions