I know this is only adjacent to OP’s point, but I do find it somewhat ironic that it is easy to find people who are just as unreliable and incompetent at answering questions correctly as a 7b model, but also a lot less knowledgeable.

Also, often less capable of carrying on a decent conversation.

I’ve noticed an periconcious urge when talking to people to judge them against various models and quants, or to decide they are truly SOTA.

I need to touch grass a bit more, I think.