Hacker News new | past | comments | ask | show | jobs | submit login

Yeah, looks like Textmate is simply running the UTF-8 algorithm over UTF-16 code units, so each surrogate is being turned into a single UTF-8 code unit (which decodes to an invalid character).

It turns out that this is such a common mistake that there's even a name for this encoding, CESU-8: http://en.wikipedia.org/wiki/CESU-8




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: