I use at least 9 devices (four laptops, a desktop, watch, two phones, tablet) with Maps on them and very much appreciate having the location data synced serverside.
You can sync data in a privacy preserving way. For example, chrome sync passwords but google doesn’t have access to them. Apple syncs health data and have access.
Etc etc.
Sync is not a reason to have server side access to location data.