Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
theturtletalks
on April 7, 2023
|
parent
|
context
|
favorite
| on:
What it feels like to work in AI right now
Is there a limit on how big the context size can be?
PeterisP
on April 7, 2023
|
next
[–]
There is a soft limit due to the computation required; the currently used model architectures are quadratic with respect to context size, so if you want ten times larger context size, that's going to need a hundred times more effort.
kickette
on April 7, 2023
|
prev
[–]
There’s no theoretical limit
Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: