If my reading is correct, this literally just distribute an LLM model and code, ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		chunsj on Nov 29, 2023 \| parent \| context \| favorite \| on: Llamafile lets you distribute and run LLMs with a ... If my reading is correct, this literally just distribute an LLM model and code, and you need to do some tasks - like building - to make it actually run, right? And for this, you need to have additional tools installed?

simonw on Nov 29, 2023 [–]

You don't need to do any extra build tasks - the file should be everything you need.

There are some gotchas to watch out for though: https://github.com/mozilla-Ocho/llamafile#gotchas

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact