Token/second performance has been excellent for me. You can use this to run any ...

		simonw on Nov 30, 2023 \| parent \| context \| favorite \| on: Llamafile lets you distribute and run LLMs with a ... Token/second performance has been excellent for me. You can use this to run any if the thousands of of GGUF models on Hugging Face, see note here: https://simonwillison.net/2023/Nov/29/llamafile/#llamafile-t...