Fwiw, that prediction was during Moore's law though. If that held until now, CPUs would run laps around what our current gpus do for LLMs.