Is the context only 1024 tokens? it seem it will cut off more and more (which is... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		m3kw9 on Dec 2, 2023 \| parent \| context \| favorite \| on: Llamafile lets you distribute and run LLMs with a ... Is the context only 1024 tokens? it seem it will cut off more and more (which is weird) after I have longer conversation.

joodfish on Dec 14, 2023 [–]

it looks like the Llamafile team is taking questions in their live Q&A tomorrow (thursday) at 1700 UTC - https://www.youtube.com/live/dwhBvUN-MD8?feature=shared

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact