Pure curiosity here, but why not just put a cap on the amount a post can be downvoted?

Cap it at say, -10; If it's truly offensive, it will probably get flagged anyways.