I remember from articles about his earlier primes work that his wife lived in San Jose i.e. on the other side of the country from him. They didn't really go into it but neither of them seemed upset by this.

That house price appreciation must just be that good.

(Also, it was reported he "worked at a Subway" but IIRC he was actually the accountant for a friend's Subway franchise.)