We certainly ban cars from driving and parking on sidewalks. We ban people turning sidewalks into commercial parking lots. And we have a whole evolving system of rules and customs worked out over the last 100 years around how to make sure cars interact safely with everything else, including licensing and policing.

Also, quite a few of these people literally did just show up to my city. Some of the most hazardous users are pretty obviously tourists.