Because it's much worse when you put people in a group and then attack that group than when you just group. "We need to help the poor", not very problematic. "The poor are lazy and deserve to suffer", very problematic.
Yes, I don't want some communist revolution or othering or dehumanization which frequently is a precursor to violence. Are you sure criticizing how other people spend their time is the best use of yours?