Your cheap cynicism makes OpenAI's lower prices sound like a reason to avoid using them, but that's backwards! It's a better strategy to use them now while prices are low and switch later if necessary. Nobody knows who will have the best prices later, so better to decide later.
Aware of what, though? We don't actually know OpenAI's profit margins on inference. Do we need to know?
It's enough to know that the market is competitive and new models with better prices are released often. This means you should have a way to switch models.
The entire market is subsided more than it is competitive. The market wouldn’t exist the same as it does today if it weren’t being propped up. Thats the point.
I remember the days when I had a $2000+ credit balance on Uber because I mastered their referral program. “Free” uber blacks for 2 years!
When you’re using free shit that you should probably be paying more for, it’s good to not fool yourself.
In the Uber example, the fact that Lyft also existed at the time didn’t matter to me as someone happily riding around the city in Uber Black for $0. Unfortunately Lyft’s referral program wasn’t so lucrative so I couldn’t switch…
> Are you saying that all of them are actually losing money?
Are you saying these companies are operating on anything resembling a sustainable business model?
I think not!
If OpenAI needs to impose 5 hour limits during a time where they are aggressively trying to grow market share, what do you think they (or whatever the winning provider is) will do in 5 years once they IPO and need to boost margins?
They won’t be as friendly with usage caps as they’re being now.
`needs to impose 5 hour limits ` I'm no OpenAI defender but that's like saying Apple is going bankrupt because they charge for their products. Why wouldn't they do everything they can to turn $20 users into $200 users?
Exactly. It is common knowledge that all the AI companies have terrible margins. IMO tokens are the cheapest they'll ever be as these companies compete for users.
To the extent that the 3rd party inference resellers are a viable market because of Chinese/certain US AI labs (current) willingness to absorb substantial compute/R&D/data harvesting costs while releasing weights on permissive licensing terms for free, then yes, current pricing is distorted.
Openrouter is not so open as well, right? They take the middle man cut by enforcing their own limit restrictions and 429s on top of the model provided limit restrictions and what not.
Now why would I pay a middle man anything if I can get the same hosted model without their own whimsical service limits?
Aware that this is essentially a soon to be deprecated service. As any vendor you need to know the life expectancy of it, plus forecast/predict any pricing changes. You really do not want to become dependent. Even if competitors exist, there still some non trivial cost to switch
agree and underscores the idea that you should keep your setups portable between model providers by using external memory systems and connector gateways
