It's not bad for something that's pretty new. Now imagine what another decade or two of development will give us. The number of areas in which a typical worker is more knowledgeable is going to get lower and lower.
Exactly. Every discussion I see focuses almost exclusively on AI as it exists right now. Everyone is either dismissing the impact due to some minor shortcoming, or wildly overestimating the short-term impact. The one consistent thing among those who dismiss it and those who think it's going to change everything in the next six months is that they're both drastically underestimating the long-term impact. GPT is already behaving in ways that researchers did not anticipate.
Two decades? It added 40 IQ points in the last six months.
It can already ingest 80kb of information instantly and use it to perform any knowledge task that can be described in that amount of info (with the 32k token model).
The number of areas in which the typical worker is better than a GPT3.5 or GPT4 system that has been properly integrated with the correct data and tools is already probably less than 5% for knowledge workers.
I was thinking specifically of all the amazing work that has been done since the Attention is All You Need paper from 2018. There’s been a lot of progress in just the past 5 years.