> If you have an infinite amount of facts, then you can memorise all of them pig... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

gpderetta on Feb 8, 2024 | parent | context | favorite | on: How we got fine-tuning Mistral-7B to not suck

> If you have an infinite amount of facts, then you can memorise all of them

pigeon-hole?

gdiamos on Feb 8, 2024 [–]

Not literally infinite, but Llama2 scale models can handle about 10 trillion tokens.

Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact