> Because there are a finite number of states, it will always loop.
No it wouldn't. The fact that it will pass through every state infinite times doesn't mean it will do it in the same order each time. Each digit of pi has only 10 possible states, but it never loops.
An interesting question might be around how many distinct loops there are and whether there's some pattern to the loop lengths.