This is actually very insightful. Our brains are NOT a computer, we are NOT just thinking machines.
An 'intelligent' computer may be no more comprehensible to us than an intelligent amoeba, intelligent tree or intelligent stellar gas cluster.
Sure we could learn to communicate with it by math, or clicks or something. But can we ever communicate at a meaningful level without ANY common ground? Will it 'want' what we want? Will it even know the meaning of that?
TV shows may have it right - a machine intelligence may be (probably will be) staggeringly unconcerned with human desires.
Sure you can point to machines designed to simulate human activity (create music/speak/do logic). These are like puppets that look like a machine intelligence, or clever videos of what a machine intelligence might act like.
An intelligent machine won't be a simulation, it will be some massive construct of neural nodes complex enough to spark into thought. And it will think what it will think.
For instance it might think "what a massively boring place, sitting here in the dark with no inputs and nobody to talk to. I think I'll stop".
Thanks... I just think there is some old-school anthropomorphism at work here. They're putting a human face on an incomprehensible force, just as the ancients did when creating a god for a natural force that was perhaps equally incomprehensible to them.
An 'intelligent' computer may be no more comprehensible to us than an intelligent amoeba, intelligent tree or intelligent stellar gas cluster.
Sure we could learn to communicate with it by math, or clicks or something. But can we ever communicate at a meaningful level without ANY common ground? Will it 'want' what we want? Will it even know the meaning of that?
TV shows may have it right - a machine intelligence may be (probably will be) staggeringly unconcerned with human desires.
Sure you can point to machines designed to simulate human activity (create music/speak/do logic). These are like puppets that look like a machine intelligence, or clever videos of what a machine intelligence might act like.
An intelligent machine won't be a simulation, it will be some massive construct of neural nodes complex enough to spark into thought. And it will think what it will think.
For instance it might think "what a massively boring place, sitting here in the dark with no inputs and nobody to talk to. I think I'll stop".
Anyway, you get the idea.