I feel differently, I always write the diacritics. There are fewer ambiguities than in Vietnamese, but enough to matter. And everything has Unicode support now.
Handwriting definitely doesn't have Unicode support. And neither does people's reading. It may even be easier to guess what someone is mispronouncing if you see exactly what they read (i.e. the letters without diacritics) than if you see the diacritics and forget they mean nothing to the other person.