Plenty of folks saying that it likely won't get that much better with the current paradigm, and blogging about the "why".

We won't know until it happens, I for one think it's gonna get much better. All that needs to happen is openai model leaking and then it'll get into highway speed once it's in the hands of the people.

Take a look at llama, once it leaked, there were new projects and optimization left and right.