Hacker News new | past | comments | ask | show | jobs | submit login

LocalLLaMA subreddit usually has some interesting benchmarks and reports.

Here is one example, testing performance of different GPUs and Macs with various flavours of Llama:

https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inferen...




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: