I my case it's more a philosophical issue. I feel fairly uncomfortable working under those regulations (to the point of contemplating quitting an otherwise very interesting job every now and then) because I have a problem with unconditionally delegating my personal decision making to some elites that "know best what's good for me" without a chance to conditionally opt out. I do understand the general concerns and that some middle ground is needed to fight abuse but personally I favor hefty fines for employers that abusing the system and good whistle blower laws/infrastructure.

I think some of this could be solved with different regulations for different kinds of jobs. More "thinky" jobs probably need a lot less regulation than say manual labor.