OpenAI opens the Decisions API to all customers: the model quickly picks from given options, answering in 100–180 milliseconds instead of 1–3 seconds
Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .
A separate class of fast models has appeared that do not write text but instantly pick the right option, and it already has competition.
According to TechCrunch, the Decisions API is a "decision model" based on Luna: instead of long text, it chooses from predefined options and rates its own confidence. The service was announced on September 29 at OpenAI's developer conference and became available to all customers on October 22. OpenAI API product lead Nikunj Handa called speed the main gain: a response takes 100–180 milliseconds instead of one to three seconds. The category was created by TypeSafe's Jev model (the company was valued at $7.6 billion after its launch): Jev ranks third on the Artificial Analysis Decision Index, OpenAI eighth.
Sources 1