We always like to avoid confrontation, whenever possible. Problem is solved from your end.
But if your site doesn't work on IE6, and your competitor's site (of comparable quality) does, you're going to lose traffic to him.
I mean, this is basically the prisoner's dilemma. Nobody wins unless we all win together.