Oh Jesus so basically it’s very feasible for me to run my own local llm on a NAS... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		kouru225 on Feb 28, 2024 \| parent \| context \| favorite \| on: The Era of 1-bit LLMs: ternary parameters for cost... Oh Jesus so basically it’s very feasible for me to run my own local llm on a NAS or a server or something… well I guess it’s time for me to get on with the times… Thanks!

anon373839 on Feb 29, 2024 [–]

Can confirm. Mistral 7B is subjectively comparable to GPT 3.5-Turbo, and the Elo scores at lmsys.org support this.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact