>Your brain has a TDP of 15W while frontier LLMs require on the order of megawatts.
You should do some basic maths; the megawatts are used for serving many LLM instances at once. The correct comparison is the cost of just a single LLM instance.
Yes, the cost figures published by LLM labs imply a power consumption measured in megawatts for each instance of top performance frontier models. Take the L.
You should do some basic maths; the megawatts are used for serving many LLM instances at once. The correct comparison is the cost of just a single LLM instance.