> doesn't seem that GPT is significantly better or worse than a human in this regard
Probably, but I think a human is much more likely to realize that they made a mistake and good-luck convincing GPT that it's wrong about something non trivial.
This is an exceptionally deep, interesting, and important statement. Is it true? Does GPT-3 occasionally make spelling errors for instance? Is the rate of spelling errors higher or lower than the average human? How about versus the average in the training data? How does the prompt affect the frequency of such errors. Ditto for other kinds of objectively measurable error.
Probably, but I think a human is much more likely to realize that they made a mistake and good-luck convincing GPT that it's wrong about something non trivial.