Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

No local inference support as of yet at least.

    Here are a few things we’d be excited to support…

        Local inference through WebGPU
        Local inference through stable-diffusion-webui
        Desktop installation
        ControlNet tools
        Tell us what you want to see!


Since I re-implement the Stability APIs with gyre.ai, it should "just work" for a local inference option.

I haven't tested though, and the API spec has lots of under-specified bits, so could be some stuff I need to tidy up.

(Alternatively, despite the post content, in the github repo there is already a webui plugin, no idea of current state).


Doesn't that just mean that local inference runs on the CPU?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: