I would be inclined to agree with you if your residence wasn't information you were required to give to your employer. It takes the normal market negotiations out of the equation.

It's like if your rent was information you were required to give to your employer. They could then make lower offers to people with lower rent, because the market conditions are now warped in favor of the employer.