No, the LLM did not solve sudoku. They simply linked a sudoku solver to an LLM.
All the LLM did was constantly invoke the solver. The solver can be downloaded from github, and works independently of the LLM.
All that experiment demonstrated is that you can use an LLM to run through a state tree...which is something that simple machine agents have been able to do for a few decades.
A friend in the music industry told me about a very cool backblaze moment.
They were out touring with an artist in some remote country, I think it was Kazakhstan, when the artists macbook suffered hard drive failure. Everything was backed up on backblaze, but the internet connections they had available was simply too unreliable to get the backup down. They contacted backblaze and for a price that was high (but not insane for a company) backblaze actually flew a guy with a physical hard drive to their location.
Saved ~5 gigs from being canceled, and my friend has been a die hard backblaze evangelist ever since.
All that experiment demonstrated is that you can use an LLM to run through a state tree...which is something that simple machine agents have been able to do for a few decades.