Indeed that's exactly why I'd not want to do it full-time!
I do it frequently enough to make me happy, and I'm lucky enough to get paid for it, in my small niches. But I've no interest in the rest of the stuff that I'd have to do if I needed to fund my life (rather just fund new camera-toys/lighting gear every month or two.)
BTW, photography is a great hobby, but doing it for a living entails very different skills, mostly of the sales and marketing variety.