Y is a legitimate concern or fear, but X may not be. But everyone wastes each other's time arguing about X.

If you figure out Y, you find common ground and compromise and that's when you find solutions.