Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Thanks, maybe it's as easy as downloading the ggml and running it with Llama.cpp. I'll try that, thanks!


there is also a python wrapper that has a web ui built in for llama.cpp, if it wasnt easy enough already




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: