All news

OpenAI opens Decisions API: the model answers with a probability, a choice or a score instead of text

Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .

When what you need is not text but a quick "yes, no, or this one", models answer many times faster and almost for free.

OpenAI opened a public beta of the Decisions API: it takes text and images and returns a structured decision instead of text, namely the probability that a statement is true, a choice from given options with a confidence level, or a rating on a scale. According to OpenAI, it runs about 10 times faster than GPT-6 Luna through the Responses API; only gpt-6-luna is supported. It costs $0.10 per million input tokens, with output tokens and cache not billed; there is no caching in the beta. Users on the forum report skewed probabilities in multiple-choice questions. According to The Decoder, use cases include damage detection, routing of customer inquiries and document classification; general availability is promised soon.

History

Models that answer with a choice or a probability, not text

7 events
  1. OpenAI opens the Decisions API to all customers: the model quickly picks from given options, answering in 100–180 milliseconds instead of 1–3 seconds
  2. Subquadratic releases SubQ Snap, a decision model for agents that processes 100 thousand tokens in about a second
  3. Cloudflare releases open model Clef-omni that picks an answer from audio, video, images and text in one pass
  4. Microsoft releases Decision-1: a model that answers with the probability of a choice rather than text, priced at $0.042 per million input tokens
  5. Liquid AI releases open d1 models that answer without text, in a single pass
  6. OpenAI opens Decisions API: the model answers with a probability, a choice or a score instead of textOpen now
  7. Amazon and Cloudflare release open "decision models": fast SIs that choose an option rather than write text
Follow on Telegram