What I occasionally see is that wearing other cultures clothing is seen as appropriation by people who aren't members of the culture, when actual members of the culture appreciate it.

If it is actual members of the culture complaining, it makes much more sense than when non members are complaining on their behalf.