Then have a dice and let it decide each token according to some rules... aka LLMs.

That's burying the lede. In the same way that one could call microprocessors random electrons jumping around.