The only reason they'd notice & care is because they received email they didn't want, right?

I assume you have an obvious 1-click subscribe on all of your emails? If not, I'd gladly mark you as spam over, and over, and over...