Part of the reason we're still here is because nukes are only controlled by a small number of powerful but mostly rational actors. If you give everyone nukes then Terrorist Timmy and Dumbass David will push the button 30 seconds after they get a hold of it.
That's a valid point, but the assumption should be that Timmy and David can't afford today the tools and facilities to build nukes as much as they won't have enough power to do anything harmful with an AI. At least for a while, hopefully.
"A while" might be 12 months given the pace we are at.
LLaMA is already going to be rather dangerous once malignant interests interests fine tune it for social engineering, offensive security missions, and astroturfing, and general emotional manipulation. That by itself will be enough to reshape the internet and remote interaction as we know it.
I agree on principle, but we already know for sure it will be used as it is in advertising, politics, news reporting, and pretty much every field in which there is constant need of new tools of mass manipulation. It's probably too late.
