Ask HN: Anyone know any OpenAI API hosted alternatives?
I am explicitly looking for API alternatives (not guis) to call GPT-3 models (don't necessarily need ChatGPT memory behavior)
Unfortunately, OpenAI's api offering has slowed down a lot and is extremely inconsistent in response times. (I'm assuming they are struggling to scale and/or sometimes you get session-ed up with a congested data centre)
This is a pretty common theme for the past few months in their community forums -> https://community.openai.com/t/api-gpt-3-5-turbo-sucks-slow/147230/8
If anyone knows a less congested alternative I would greatly appreciate it (don't mind if it's of lesser quality responses)
Yes that is the truth the open AI API is indeed very slow and inconsistent. Have heard people say that Azure open AI integration is a little better ?
Claude is also under limited preview right now.
Also waiting for some reliable API which can be used in customer facing applications
Claude isn't super fast either. It's about a third or so.
https://makersuite.google.com/
claude ai https://www.anthropic.com/earlyaccess
Azure openai api https://azure.microsoft.com/en-us/products/cognitive-service...
claude is under limited preview right ?
1. Claude by Anthropic (but, expect to wait weeks/months before getting off the waitlist, which makes their offering pretty uncompelling)
2. Cohere
3. https://inferkit.com or https://textsynth.com/pricing.html
https://www.anthropic.com/index/introducing-claude
You might want to try NLP Cloud: https://nlpcloud.com
What do people think about a self hosted gpt-j 6b model?
[dead]