According to anti-discrimination laws in many countries, not exactly. Some of it is down to judges opinion but many times there are concrete boundaries for what is considered both harassment and racism.

Usually if you have to ask, it is.