All news

OpenAI will let outside reviewers access models during training, but without the "desks and badges" Altman promised

Prepared by Sintelligent with the help of SI. Publication time restored from the build log. . Updated: .

Outside oversight of SI training is becoming an industry norm, but so far on the labs' own terms.

Previously, third-party organizations reviewed OpenAI models only before release; now the company is ready to admit them at the training, evaluation and deployment stages and is in talks with METR and Redwood Research. The priorities are independent review of safety cases, safeguards, assessments of dangerous capabilities (chemistry and biology, cybersecurity, SI self-improvement) and investigation of serious cases of misalignment. But the announcement names no partners and gives no access terms, saying only that reviewers "may be invited to offices" for the most sensitive work, whereas ten days ago Altman promised them "desks, badges and laptops" with the right to publish their findings.

Sources 2

thenextweb.comaiweekly.co
History

External auditors at SI labs

8 events
  1. METR and Redwood Research spent three weeks testing OpenAI's internal agent monitoring system: by their estimate, 75–94% of traffic was eligible for monitoring; OpenAI says the vulnerabilities have been fixed
  2. METR reviews the section of Anthropic's report on misalignment risk: the risk is "low", but by its assessment because of the models' limited capabilities, not safeguards
  3. Anthropic gives six METR staff access to its internal systems close to that of its own employees; they will be able to publish findings without approval
  4. METR publishes five pieces on independently assessing labs' risk of losing control of SI
  5. Independent SI model evaluators METR, Apollo Research and Transluce are at the center of the safety debate, but how to fund them is unresolved
  6. OpenAI will let outside reviewers access models during training, but without the "desks and badges" Altman promisedOpen now
  7. More than 100 researchers, including Hinton, name five conditions without which "external reviewers" inside SI labs are useless
  8. Anthropic lets outside auditors from Accenture inside the company, with the same access as employees
Follow on Telegram