Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Sorry for offtopic: Are there any LLM services that I can use in cloud similar to OpenAI? I do not have good enough Macbook to run different models locally


AI21 Labs provides access to its Jurassic-2 LLM (and derived models for summarization, grammatical error correction etc.) via a web UI [1] and an API.

Disclaimer: I'm a software engineer at AI21.

[1] https://www.ai21.com/studio


If you use the LLM Chatbot arena[1], you can get two bots to compete to solve your prompts!

[1]: https://chat.lmsys.org/?arena


Hmmm... OpenAI itself?

Did you intend to rule out OpenAI from consideration?

You mentioned hardware being a constraint, but that doesn't tell me why you specifically wanted to find an alternative to OpenAI.


Not OP, in my case OpenAI does not want my money, they only accept credit cards. For example netflix wants my money so they have more choices.

Also I would like to pay for an equivalent alternative that is less censored, like ChatGPT had a bug one day that it refused to tell me how to force a type cast in TypeScript, it showed me a moderation error. So I want an AI that is targeted for adults and not children in some religious school in USA.


there is a somewhat unfiltered GPT4 at Azure, but they really don't want anybody's money (afaik only "trusted" corporate entities can access it)

at this time, your only option is local models. if you don't have the hardware to run them yourself, there are plenty of hosts - poe/perplexity/together etc.

llama3 is (hopefully) coming soon, and if it has improved as much as llama2 improved over llama1, and provides at least 16k baseline context size, it will be in between gpt3.5 and gpt4 in terms of quality, which is mostly enough.


Yes, there are 2 issues for me, my hardware is not powerful enough, only 8Gb vram and the models are still not intelligent enough. At this moment I have opened tabs for different websites and when I ahve a question I compare them and see the state. I would like a model that would say I do not know more often then respond with the wrong thing, also I would like it to follow instructions , now I ask them to "rewrite previous response but without X" and they respond "sure, here is the response without X " and they do not followed the instruction, like they are "hard coded" to do X. An example for X is "do not add a summary or conclusion"


I have used openAI but I want to try several other LLMs as well.


TogetherAI: Unaffiliated, but I've found it good.

Others include Runpod, Replicate, probably others.


I think Anthropic and Mistral offer this but you have to join their waiting lists first.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: