> If you have an infinite amount of facts, then you can memorise all of them pig... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		gpderetta on Feb 8, 2024 \| parent \| context \| favorite \| on: How we got fine-tuning Mistral-7B to not suck > If you have an infinite amount of facts, then you can memorise all of them pigeon-hole?

gdiamos on Feb 8, 2024 [–]

Not literally infinite, but Llama2 scale models can handle about 10 trillion tokens.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact