Agreed. If I don't get a good answer, I'll edit my input, rather than continuing with an attempt to correct it.
There's a context size, and there's a "comprehension" size. They appear to be completely unrelated, with comprehension being an incredibly small fraction of the context window.
There's a context size, and there's a "comprehension" size. They appear to be completely unrelated, with comprehension being an incredibly small fraction of the context window.