Because people generally find that informed consent is the only consent that counts. If someone cannot read a contract, how can they give informed consent to it?

If we decide that uninformed consent is still consent, we open a significant problem. And if we try to patch it by selectively applying the standard, we introduce arbitrariness which is an even larger problem.