Every major Cloud vendor is trying to develop their custom AI ASIC. Putting Google aside, Amazon has trainium/inferentia, which Anthropic uses quite extensively. Microsoft is doing sth. similar, although they are quite behind. OpenAI is doing it. Meta is doing it. That's why the stock price of Broadcom/Marvell soared.

I remember Kumo was focusing on GNN when it was founded (Jure's strength back then). Looks like they are pivoting or have pivoted.

You are basically doing a heurstic. Your solutions are not guaranteed to be optimal. Integer programming is the way to do.

If you are not a paying GCP user, there is really no point to even look at Vertex AI.

Just stick with AI Studio and the free developer AI along with it; you will be much much happier.

Really appreciate your team's enormous efforts in this direction, not only the cutting edge research (which I don't see OAI/DeepMind publishing any paper on) but aslo making the content more digestible for non-research audience. Please keep up the great work!

His Alibaba/Arm bets are legendary. Both made $100B+

Housing is definitely not easily affordable. But the other points are valid.

For top talent it might be.

"if you are rich, life is good" can be said about anywhere

Cool blog

there is limited TPU support in pytorch via torch_xla

Sounds limited

When he drops a vid, you don't ask questions. You watch first and then ask questions :)

I appreciated the question, because the video is 3hr30min long, and karpathy's answer here was helpful to know that it's not directed at me.