We do prosecute humans who misuse weapons. The problem with AI is that the potential for damage is hard to even gauge; potentially an extinction event, so we have to take more precautions than just prosecuting after the fact. And if the AI has agency, one might argue that it is responsible... what then?
What might be scary is using AI for a mass influence operation, propaganda to convince people that, for example, using a weapon is necessary.