GPT4 is trained on almost the entire Internet. Presumably they have found a new way to learn which is closer to the way humans learn. After that, getting better is just a matter of optimization and more compute.