Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

I believe that is University lab level of compute, right?

It is so nice to see that you don't need tech oligarch level of compute for stuff like this.




A quick research shows a 8 GPU A100 80GB server can easily be 120-150k a pop. So you are looking a few million in hardware costs if you wanted these on prem. The energy cost for the training is insignificant from my calculations.

So yeah, I imagine this is not a big deal for large, well funded, universities.

Biggest issue with these is ROI (obviously not real ROI) as GPUs have been progressing so fast recently for AI usecases that unless you are running them 24/7 what's the point of having them onprem.


Ye I mean, you don't have to do it, just that you can, can be enough.




Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: