Anthropic will rewrite part of its leaked frontier SI model safety bill after criticism
Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .
The rules for the most powerful SI models are still being written amid dispute, and even the company itself admits its first draft was imprecise.
As The Next Web reports, under the draft the government could block a model's release only in narrow cases: a foreseeable, imminent risk of damage of $1 billion or more, or 50 or more deaths and injuries (bioweapons, model "escape", cyberattacks). Independent evaluators would have to register with the Department of Commerce and report risks within 72 hours, and the draft would have preempted some state laws. Criticism came from SI safety advocates, California state senator Scott Wiener and former White House adviser David Sacks; in their assessment the draft is weaker than the bipartisan FRONTIER Act. Anthony Cimino, who leads federal affairs at Anthropic, said the wording on preempting state laws is "not precise enough" and will be updated; the company also promised to revisit the risk thresholds and the requirements for evaluators.
Sources 2