Hacker News new | past | comments | ask | show | jobs | submit login

The AI hardware requirements are currently insane; the models are doing with Megawatts of power and warehouses full of hardware what an average Joe does in 20 Watts and a 'bowl of noodles'.



They handle many more requests per second than an average Joe


Not really. They have large contexts and lack of proper caching for "reasons".




Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: