> 50TB There's no way the entire Web fits in 400$ worth of hard drives. | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		andrepd 71 days ago \| parent \| context \| favorite \| on: How large are large language models? > 50TB There's no way the entire Web fits in 400$ worth of hard drives.

flir 71 days ago | [–]

Nah, Common Crawl puts on 250TB a month.

Maybe text only, though...

AlienRobot 71 days ago | [–]

Text is small.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact