Speaking the language and speaking with an accent are two different things. Learning to listen to someone with an accent is a skill you can develop, same as they can develop their english skills (which they will, with practice and time).