I have yet to see a convincing hypothetical where an ai could destroy the human race. Assuming you were a perfect intelligence with instant admin access to every computer connected to the internet (which is already a leap) could you destroy the human race? How would you? I don’t think you can, unless you get very hare brained about human manipulation and crashing economies and even then not human extinction level.
Also when people talk about AI at the end of the day it’s kind of limited by human tech and the internet. Tech is big the entire fucking ecology of earth is bigger. Ecological collapse to me seems worse than any kinda technological collapse of a rogue ai.
Also any situation where an ai could do something a human organization or government body could do it sooner and with a more deliberate malicious intent
Humans do not have tough hide, or sharp claws, or fast sprinting. We are a drain on resources for over the first decade of our lives. Our vision and hearing are okay but not at all state of the art, and our sense of smell is terrible. Our muscles are weak and our teeth fragile.
We have an extensive long list of severe downsides and only one distinct upside: our brains are sightly more sophisticated. Brains with a few more ridges and roughly 50-200% more neurons than our mammal siblings. I'll be generous and say we are 3x smarter than the nearest ape. That slight advantage has granted us absolutely total and permanent control over the futures of all other species in ways by using means they cannot comprehend. We can and do work towards our goals with no concern that animal life will be even a small impediment. We can render them extinct at will, often eliminating massive species by accident.
Our subgoals are not very different, we act in self-preservation, we seek larger and more stable resources, etc. The only difference is that we use advanced means and our primary goals may be understandable to an ape. An ape may realize we would prefer to have many fruit trees to few and that we may put our firsts up to protect our face from an enemy. But an ape cannot understand or predict that we will build giant motorized combines to harvest planted crops, or that we will discover atoms and fission and find a way to smash two metal rocks together that kills many many face-attacking foes at once. Those things are pure scifi or fantasy to them.
Something more broadly intelligent than us would thus be capable of things that are scifi to our minds. We know from GoAlpha that narrow intelligence can be created that is not merely 3x smarter but in fact far far beyond our brightest minds. We don't know what it's doing but we know what its goal is, which is to win the game. We know from models like GPT-4 that below-human but wide and generalized intelligence across many domains is possible. The only one missing is above-human general intelligence, which we are now clearly closing in on. We don't know exactly what it will do just as we don't know what the Go bot will do, but we do know some of its subgoals and we do know that it will be able to accomplish whatever goal it has unilaterally, and that the entire rest of life, including humans, will be completely powerless to stop it.
Also when people talk about AI at the end of the day it’s kind of limited by human tech and the internet. Tech is big the entire fucking ecology of earth is bigger. Ecological collapse to me seems worse than any kinda technological collapse of a rogue ai.
Also any situation where an ai could do something a human organization or government body could do it sooner and with a more deliberate malicious intent