I've been studying machine learning lately... Here is my take:
Well before we create an ASI (artificial super intelligence) we will have put 90% of the human race out of work with specialized (non conscious) intelligent agents... (for example, self driving cars). I believe that this will be a disaster for our society as it exists today. My hope is that we will adapt and make the necessary societal changes so that we can reap the benefits of this technology.
Everyone assumes that an ASI will be able to augment itself and learn exponentially. I suspect that this will be true if the nature of the brain is defined by a single algorithm. If the brain is not defined by a single algorithm and is instead a big ball of complexity then our ASI's will not be able to grow exponentially any more than we can (they will likely not really understand their own consciousness, just like we don't).
If a single algorithm defines the brain, then I suspect humans will be able to augment their brains with machine intelligence as well. If we can augment our brains, then we're playing the same game as the machines.
If it proves impossible to augment our intelligence, I suspect that an ASI would still preserve humanity if only to preserve us for future potentialities.
ASI are much more fit for space travel than us.
1) Not nearly as sensitive to radiation, so less shielding, so less fuel.
2) Much less stringent environmental requirements (no heating, cooling, air, food, etc.)
3) Ability to sleep for incredibly long periods means ASI is far more suited than us for exploring the cosmos.
I suspect that an ASI might leave us alone simply because the universe is so vast, and entirely open to it.
There's a nice glimmer of hope, that we may be the slaves that build the interstellar rocket ship monument to our AI god so it can beetle off to a nicer looking star system (or super-massive black hole?) better suited to it (e.g. more energy, more matter.)
I think we could get it right eventually, but the only solution I can imagine seems to be along the lines of a universal basic income, or access to basic resources (food, water, shelter, education, clothing, healthcare, etc.) without cost.
Given the resistance we are currently observing to Obamacare, the fact that "socialism" is regularly bandied at the current administration as a pejorative and the disdain for "handouts", this seems like a stretch. Perhaps we'll get there eventually, but not before a lot of pain.
Judging from the past, we won't be able to solve this challenge. Some thought that the industrial revolution would let everyone work shorter hours but still make enough money, but the result was fewer workers working for longer, and most of the rewards of production going to capital rather than labour.
The resurgence of right-wing movements means that any ideas about sharing national income with the unemployed will probably be laughed out of the room.
Well before we create an ASI (artificial super intelligence) we will have put 90% of the human race out of work with specialized (non conscious) intelligent agents... (for example, self driving cars). I believe that this will be a disaster for our society as it exists today. My hope is that we will adapt and make the necessary societal changes so that we can reap the benefits of this technology.
Everyone assumes that an ASI will be able to augment itself and learn exponentially. I suspect that this will be true if the nature of the brain is defined by a single algorithm. If the brain is not defined by a single algorithm and is instead a big ball of complexity then our ASI's will not be able to grow exponentially any more than we can (they will likely not really understand their own consciousness, just like we don't).
If a single algorithm defines the brain, then I suspect humans will be able to augment their brains with machine intelligence as well. If we can augment our brains, then we're playing the same game as the machines.
If it proves impossible to augment our intelligence, I suspect that an ASI would still preserve humanity if only to preserve us for future potentialities.
ASI are much more fit for space travel than us. 1) Not nearly as sensitive to radiation, so less shielding, so less fuel. 2) Much less stringent environmental requirements (no heating, cooling, air, food, etc.) 3) Ability to sleep for incredibly long periods means ASI is far more suited than us for exploring the cosmos. I suspect that an ASI might leave us alone simply because the universe is so vast, and entirely open to it.