Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

As it has been mentioned numerous times in the past, we are not the average user. I don't know anyone outside our bubble who would bother running a local LLM, or going into all the trouble building an x8 GPU rig to run one of the biggest models.


Easy to run locally for geeks means easy to package up and sell to non-geeks.


Why would non-geeks want to run a local LLM? Electricity prices alone are quite high. Why not pay a subscription on a cloud service and be done with it.


My point is that you will have many cloud services to choose from if geeks can build them easily, which will keep prices down.


Privacy could be one reason. There are a lot of cases where people do not want to send data to a cloud service.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: