So can I be intolerant of that? Or can the irony only go one level deep?

I wonder, what part of "speaking up against a person who wants your rights taken away" disturbs you? As long as "not tolerating to intolerance" doesn't mean taking away his rights, I don't see the problem.

Death to the intolerant!