> What about the glaring safety implications of the custody of this power being in the hands of a relatively small number of people, any of whom may be compelled at any point to divulge that power to those with bad intentions? Secretly?
What you are looking for is a publication known as "Industrial Society and Its Future"
More commonly known as “ The Unabomber Manifesto”[1]
> 1995 anti-technology essay by Ted Kaczynski… contends that the Industrial Revolution began a harmful process of natural destruction brought about by technology, while forcing humans to adapt to machinery, creating a sociopolitical order that suppresses human freedom and potential.
> 172. First let us postulate that the computer scientists succeed in developing intelligent machines that can do all things better than human beings can do them. In that case presumably all work will be done by vast, highly organized systems of machines and no human effort will be necessary.
> 174. On the other hand it is possible that human control over the machines may be retained. In that case the average man may have control over certain private machines of his own, such as his car or his personal computer, but control over large systems of machines will be in the hands of a tiny elite-just as it is today, but with two differences. Due to improved techniques the elite will have greater control over the masses; and because human work will no longer be necessary the masses will be superfluous, a useless burden on the system.
I always thought a good addendum to 174 is that the ai will be compelled to generate extremely effective propaganda to convince the non elite that this situation is good.
I would sure hope so, but so far I haven't seen anything convincing. The industrial machinery keeps marching on.
At this point I'm predicting that the transition to renewables will fail due to the enormous costs involved (aside from transportation there are also things like converting metal industries to electric), combined with increased EROEI of fossil fuels eventually making extraction too expensive to maintain expected outputs.
It's still somewhat far into the future but it's seems to be happening, which is a comfort from the perspective of Ted's insights, but on the other hand it's not going to be any less violent, even though it would happen as an unintended side effect rather than through conscious effort.
People will once again need to become skillful in multiple areas, compared to the current specialization economy where every person is pretty much useless unless part of the "machinery".
193. The kind of revolution we have in mind will not necessarily involve an armed uprising against any government. It may or may not involve physical violence, but it will not be a POLITICAL revolution. Its focus will be on technology and economics, not politics.
I don't really understand.. Pretty sure he wasn't worried about "safety implications" in that. Is this just like a snarky thing? Like having any kind of critiques about technology means you must be allied with the unabomber?
People have spilled a lot more ink than that on this subject! And most of them weren't also terrorists.
What you are looking for is a publication known as "Industrial Society and Its Future"