Does OpenAI on azure still have that insane latency for content filtering? Last ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

com2kid 21 days ago | parent | context | favorite | on: Gemini CLI

Does OpenAI on azure still have that insane latency for content filtering? Last time I checked it added a huge # to time to first token, making azure hosting for real time scenarios impractical.

shakna 21 days ago [–]

Yes.

Unless you convince MS to let you at the "Provisioned Throughput" model. Which also requires being big enough for sales to listen to you.

Consider applying for YC's Fall 2025 batch! Applications are open till Aug 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact