Globally perhaps not as fishing and hunting have been major food sources in antiquity especially when you include North America etc. Similarly slavery meant a significant portion of the population was in effect outside the economy.

That said, there’s been areas where 90% of the working population was at minimum helping with the harvest up until the Middle Ages.