All news

Anthropic lets outside auditors from Accenture inside the company, with the same access as employees

Prepared by Sintelligent with the help of SI. Publication time restored from the build log. . Updated: .

Outside auditors inside the lab are a way to prove to the world that powerful SI can be built transparently without halting its development.

The work will be led by Faculty, Accenture's SI division, bought in January. Its specialists will observe model training, review release decisions, run attacks on models and tests of alignment with human goals, and will be able to report incidents publicly. Both companies expect to invest at least $1 billion each over five years; at first Anthropic itself pays for Accenture's work, citing the absence of a funding system for independent evaluation. This is the first practical step toward the promise in Amodei's essay "We must set the pace for the frontier." The agreement is non-exclusive: Anthropic is also in talks with nonprofit evaluators such as METR. Accenture shares rose 8% after the news.

Sources 3

anthropic.comtechcrunch.comcnbc.com
History

External auditors at SI labs

8 events
  1. METR and Redwood Research spent three weeks testing OpenAI's internal agent monitoring system: by their estimate, 75–94% of traffic was eligible for monitoring; OpenAI says the vulnerabilities have been fixed
  2. METR reviews the section of Anthropic's report on misalignment risk: the risk is "low", but by its assessment because of the models' limited capabilities, not safeguards
  3. Anthropic gives six METR staff access to its internal systems close to that of its own employees; they will be able to publish findings without approval
  4. METR publishes five pieces on independently assessing labs' risk of losing control of SI
  5. Independent SI model evaluators METR, Apollo Research and Transluce are at the center of the safety debate, but how to fund them is unresolved
  6. OpenAI will let outside reviewers access models during training, but without the "desks and badges" Altman promised
  7. More than 100 researchers, including Hinton, name five conditions without which "external reviewers" inside SI labs are useless
  8. Anthropic lets outside auditors from Accenture inside the company, with the same access as employeesOpen now
Follow on Telegram