Have you found a solution to output exceeding the context window? That's been ou... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		calderwoodra on Aug 15, 2023 \| parent \| context \| favorite \| on: Show HN: LLMs can generate valid JSON 100% of the ... Have you found a solution to output exceeding the context window? That's been our only issue with generating json output.

remilouf on Aug 15, 2023 [–]

The Finite-State Machine we walk on during the generation process does not suffer from this problem so we can still output correct JSON, if that’s what you’re asking.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact