There are already LLMs hosted across the internet (Folding@Home style) instead o... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

alexvoda on April 7, 2023 | parent | context | favorite | on: What it feels like to work in AI right now

There are already LLMs hosted across the internet (Folding@Home style) instead of in a single data center.

Just because the swarm infrastructure hosting an LLM has higher latency across certain paths does not make it a swarm of LLMs.

staunton on April 7, 2023 [–]

> There are already LLMs hosted across the internet (Folding@Home style)

Interesting, I haven't heard of that. Can you name examples?

alexvoda on April 7, 2023 | [–]

I read about Petals (1) some time ago here on HN. There are surely others too, but I don't remember the names.

1. https://github.com/bigscience-workshop/petals

Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact