A few years ago I was in a group of people using English to talk. I was the only native speaker,and honestly had more trouble communicating as a result. I have a strong west country accent and people are not used to it. And there are lots of colloquialisms that you use without thinking about it.