The exceptions to the first amendment are largely rooted in historical practice, which informs what the founders would have understood the scope of free speech to be. I don't think its a supportable statement that they would have understood all forms of censorship to violate the first amendment.