How can I run some inference with this model locally? Do I have to make a huggin... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		ftxbro on May 5, 2023 \| parent \| context \| favorite \| on: MosaicML MPT-7B: A Commercially-Usable LLaMa-Quali... How can I run some inference with this model locally? Do I have to make a huggingface account?

edtechdev on May 6, 2023 | [–]

I'm not sure, but maybe GPT4All will eventually add support for it: https://gpt4all.io/

fswd on May 6, 2023 | [–]

if you can't figure it out send me an email and I can help you figure it out

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact