I think of criticizing the defense as criticizing the argument or reasoning offered.

Put another way, if the problem is with the assumptions, the criticism goes far deeper than just that defense.