Right. The error is in thinking that "just code and maths" can't reason.

LLMs very obviously are reducible to "just code and maths". We know that, because that is how they are made.