Why so few ask: Isnt it enough that current SOTA AI make us humans already so much better everyday?
Exponential selfimprovement seems like a very scary thing to me and even if all went right, humans have to give up their pole position in the intelligence race.
That will be very hard to swallow for many.
If we really want self improvement, we should get used to beeing useless :)