I definitely agree with your point, but outdoor public spaces in the US are now primarily roads subject to extensive regulation. Despite what an ad for a new truck may try to sell you, driving is not part of free society.
How is freedom to travel with out government oppression not part of a free society
Keep in mind public roads, in the US, pre-date Automobiles, pre-date even the founding of this nation. and I think the idea that free travel upon public roads was not a core freedom would be a shock to the Founders