Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Is there a limit on how big the context size can be?



There is a soft limit due to the computation required; the currently used model architectures are quadratic with respect to context size, so if you want ten times larger context size, that's going to need a hundred times more effort.


There’s no theoretical limit




Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: