Maybe this doesn't bother you at all. But the structure of your argument also supports anti-interracial marriage laws.
Blacks and whites are treated the same - both are free to marry people of the same race. Some may prefer not to do that, but they do have the legal right.
It's not my argument. I'm one of those wackos who believes the government should get out of the marriage game (i.e. I want to end straight marriage), stop favoring the immobile over the mobile, and stop favoring people with risk preferences that result in the purchase of health insurance.
I'm simply trying to square the standard left wing position that the government can and should regulate anything on the slightest pretext with the other standard left wing position that the government has no right to regulate gay sex. But somehow, in spite of regulation of gay sex being illegitimate, regulation of incest or polygamy is still perfectly legitimate.
Note that I'm attempting to reason from first principles here, not appeal to consequences.
Blacks and whites are treated the same - both are free to marry people of the same race. Some may prefer not to do that, but they do have the legal right.