Hacker Newsnew | past | comments | ask | show | jobs | submit | leetharris's favoriteslogin
1.M2 Ultra can run 128 streams of Llama 2 7B in parallel (github.com/ggerganov)
268 points by behnamoh on Oct 11, 2023 | 173 comments

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: