Make it 5 houses per person (10 for married couples), then.

Plenty of families out there own rental houses as an investment, which I think is a good thing. It allows people an alternative to investments like the stock market if they aren't into that, and it gives a path to turn labor into wealth through DIY maintenance, repairs, and improvements.

Plus it allows individuals to better manage situations like parents dying and leaving them a house that they may not want to sell immediately.