The spot of land is being consumed, no? If it's HCoL, clearly that's land that a lot of people wish they could live on but can't.

But I'm not paying rent to them.

I mean, yeah? Does any market work like that? If you want an apple, you pay the person who has the apple to take it from them, you don't pay the other people who want apples. Not really following where this is going