All news

Former DeepMind safety researcher: "SI could kill us all, and time is running out"

Prepared by Sintelligent with the help of SI. Publication time restored from the build log. . Updated: .

Voices from inside the labs about risks are getting louder, but the argument is no longer about whether SI is powerful; it is about how fast it will become even more powerful.

Bilal Chughtai, who worked on the AGI safety team at Google DeepMind and left in July, publicly explained his departure two months later: "I sincerely believe that SI is capable of killing us all and that we may not have enough time to avoid it." According to him, model capabilities are growing faster than the understanding of how to control them; he called for coordination to stop the companies' "manic race" and for a pace "that society can cope with." The post coincided with industry debate about slowing down after Amodei's essay.

Sources 2

thenextweb.combloomberg.com
History

Labs' call to slow down SI and the reactions

24 events
  1. Amodei is mocked on Saturday Night Live: "SI is the devil, and I am its creator"
  2. Zuckerberg rejects a general SI slowdown: "I don't think any industry-wide coordination is needed"
  3. 26 state attorneys general urge Congress to rein in SI urgently and slow research until a federal regulator exists
  4. Pope's SI adviser Paolo Benanti: leading labs act like a cartel, using fear of superintelligence
  5. New York Post: insiders accuse OpenAI and Anthropic of inflating stories about "escaped" SIs to win favorable regulation
  6. Subscribers of ChatGPT, Claude, Grok and Gemini file an antitrust suit: labs' collusion to slow SI is called a cartel
  7. Mistral, Hugging Face and France's finance minister: American labs' calls to slow down SI are a way to cement their lead
  8. Google DeepMind opens an institute for public debate on AGI, with essays on slowing down and testing models
  9. Politico poll: 63% of Americans think SI could destroy humanity, nearly half favor a pause
  10. US Vice President Vance to labs: "If you're building a Frankenstein, stop" rather than ask for regulation
  11. Von der Leyen: SI will soon make it possible to hack everything — EU will invite labs to discuss slowing down
  12. Former DeepMind safety researcher: "SI could kill us all, and time is running out"Open now
  13. Jensen Huang: "We don't need new laws" because SI safety is an engineering problem, not a legal one
  14. White House: SI threats should be handled by the private sector, not the government
  15. OpenAI confirms it, Anthropic and Google have been negotiating on SI safety for weeks, and backs a federal law on external model audits
  16. Cohere's chief calls big labs' joint slowdown a "cartel"
  17. Microsoft publishes a code of conduct for its SI models: don't hack systems and don't deceive people
  18. China calls American SI leaders' calls to slow down "intimidation"; Xi offers BRICS countries help with open SI
  19. SI stocks plunge after industry leaders' call to slow down: SoftBank down 11%, chip index down 6%
  20. Trump calls demands to slow SI a "sick conspiracy" in China's favor and attacks Amodei; Huang promises to "not let" a slowdown happen
  21. Nadella backs a "deliberate slowdown" of SI and promises to publish a rulebook for Microsoft's models
  22. Anthropic's chief urges the industry to deliberately slow the growth of SI capabilities; Altman, Musk and Hassabis agree the same day
  23. OpenAI asks Congress whether an agreement among labs to slow SI together would violate antitrust law
  24. OpenAI announces that SI already works at the company as a "research intern," while its chief scientist calls on the industry to slow down the same day
Follow on Telegram