Google solved a real problem. They indexed the web and made search work, and they did it very cheaply. So cheaply, in fact, that they could give their service away to users and monetize it with ads. LLMs are not like this. They're both extremely expensive to run and they don't do anything truly valuable--there's no killer app. So how exactly is OpenAI or their ilk (or for that matter the rest of us) supposed to use these things to make money?
This is the only question, and the fact it's still an open question just screams "hype bubble". My bet is this AI stuff goes the way of the NFT.
I'd take that bet. Google offers a very expensive service for free, but is able to monetize it with ads. Sometimes connecting users to companies is what users actually want. But Google has this problem that since the service is free, its users feel entitled to everything for free. They can't just go and charge people what it costs to run a Google search.
OpenAI doesn't have this problem. ChatGPT has a free level to get you hooked, but it's restricted. So a lot of users pay them $20 or $200 or some other amount per month to use their service. So how OpenAI makes money is by selling access to their service. What you do with it is up to you, but their value proposition is simple. Pay us to get more/better access to our service.
How much it costs them to operate the service is a secret known only to them. There are a lot of very very educated guesses, but they're just guesses. After the VC money runs out they'll have to charge more than it costs to provide the service to stay afloat, and then we'll see. $20/month for ChatGPT plus is the $1 Uber that got people hooked. There's already a $200/month tier.
Whether OpenAI, specifically, will be standing in 20 years, only time will tell. But by this point it should be obvious that there's something to this LLM thing. Even if the product doesn't get any better than it is today, it'll still take 5-10 years for its effects to reverberate through society.
The killer app is LLM-accelerated programming. Sure, it doesn't work for all domains and it can't do everything, but even if the only thing it's good for is creating JavaScript react CRUD apps, well, there are a lot of those out there, and they're not actually limited to that. And since tool use means they can generate code and compile it and test that it works, it's possible to generate datasets for other languages and libraries, the only question is which ones is it worth it for.
It might not help at all in your line of work, but a friend who does contracting is able to use LLMs to cut the time it takes him to do a specific kind of job in half, if not more,
enabling him to take on twice as many clients and make more money. For him it would still worth it even at 100x the current price. thankfully competition means it'll take a while before it's that expensive.
