The AI hardware requirements are currently insane; the models are doing with Meg... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		briansm 84 days ago \| parent \| context \| favorite \| on: Google AI Ultra The AI hardware requirements are currently insane; the models are doing with Megawatts of power and warehouses full of hardware what an average Joe does in 20 Watts and a 'bowl of noodles'.

KineticLensman 84 days ago [–]

They handle many more requests per second than an average Joe

otabdeveloper4 84 days ago | [–]

Not really. They have large contexts and lack of proper caching for "reasons".

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact