I think you're overlooking more quotidian needs like for fuel or industrial production. Still waiting to hear if you have any actual candidates rather than abstractions/potentialities. This should at least be possible for AI, since we're on the verge of building it.
Like say AGI comes into being tomorrow, and wants to maximize its capabilities by building more of itself, OK. But there is no shortage of empty space in which to do so. It seems like it would be more efficient to improve human welfare in exchange for help with physical tasks than to set about exterminating humans and then have to construct tons of new machinery to mine new resources. Like, what is the payoff for annihilation?
Like say AGI comes into being tomorrow, and wants to maximize its capabilities by building more of itself, OK. But there is no shortage of empty space in which to do so. It seems like it would be more efficient to improve human welfare in exchange for help with physical tasks than to set about exterminating humans and then have to construct tons of new machinery to mine new resources. Like, what is the payoff for annihilation?