A genuine bad rewrite would tend to affect all candidates uniformly (except those who have pre-anonymized their applications, thus gaming the process), but a find-replace is more problematic.

If that's an issue, the companies could just tell applicants to pre anonymize their resumes to eliminate any potential gaming.

I think it's worthwhile A/B testing your idea.