I would equate this with a form of extreme slander, so your inference is wrong. They aren't a problem because they are real, they are a problem because they can be passed off as real, and the issue is in the reputational damage. I'm not saying there's a good solution but I don't think the problem should be dismissed so easily.
But if they were not yet passed off as real, is it pre-crime? If I create a satirical fictional work about someone, is it "extreme slander" because a portion can be taken out of context and presented as real? Should my work be preemptively censored?