No, it's a misnomer in my opinion. And that hides a rather nasty twist in human relations:

In order to shun someone from a social group due to their non-conforming behaviour, the group cannot simply accept that they are willingly excluding this person. Because that would violate the basic premise upon which the group is built: comradery and loyalty. So the group must rationalize their behaviour by sticking all the blame on the individual being excluded.

You can go medieval and call someone a witch, or just be a bit more moderate and blame them for something vague like having "low self-esteem".