Yeah, definitely a miscommunication issue. Without the "sorry" it would have come off normal, but depending on the tone and inflection of "sorry" to native speakers it could either be complete sarcasm or genuine bewilderment. But the default here would be the former :)