Regulatory pressure. With privacy comes illicit use. With illicit use, "what about the children / terrorism / etc..." becomes enough of a reason for regulators to pressure centralized exchanges to drop support. Without widespread adoption, centralized exchanges are needed to swap with more widely accepted monetary devices. If centralized exchanges are blocked, the on/off-ramp for privacy coins suddenly becomes much more difficult.