I think there are obvious cases where passive moral conformists (which you would argue are at the bottom of PG's rankings) are a net good in the world. PG doesn't spend any time highlighting this because it is not the focus of the essay.

Classifying people by their expressed personality is the best way to do it. If you refuse to judge a person by the content of their character you are blinding yourself.