$1 million/year without working is very rich. You could definitely have multiple houses and full time assistants. I have two houses and part-time assistants at an income of $300k. And most of my time is dedicated to work at someone else's company, owning all of your own time makes them much more wealthy than me.
I'm not really arguing with that. But there's a difference between being very comfortable and money basically being a non-factor even for expenses that the typical person would consider a complete extravagance/unaffordable and cost basically being completely irrelevant.