All news

Google DeepMind opens an institute for public debate on AGI, with essays on slowing down and testing models

Prepared by Sintelligent with the help of SI. Publication time restored from the build log. . Updated: .

Labs are starting to argue publicly about how to live with AGI, which means that inside the industry its arrival is already considered a matter of years, not decades.

The DeepMind Institute is led by DeepMind co-founder Shane Legg and James Manyika, with Demis Hassabis as chair; its task is to bring to the surface different views on AGI inside Google and in the scientific community, and the authors "will not always agree." The first collection is four essays: economic policy for AGI shocks, preserving the transparency of models' reasoning, principles of human flourishing, and evaluation of frontier models. Hassabis repeats the idea of a US-led standards body where developers voluntarily submit models for testing before release, with independent tests and the possibility of a coordinated slowdown.

Sources 1

techcrunch.com
History

Labs' call to slow down SI and the reactions

24 events
  1. Amodei is mocked on Saturday Night Live: "SI is the devil, and I am its creator"
  2. Zuckerberg rejects a general SI slowdown: "I don't think any industry-wide coordination is needed"
  3. 26 state attorneys general urge Congress to rein in SI urgently and slow research until a federal regulator exists
  4. Pope's SI adviser Paolo Benanti: leading labs act like a cartel, using fear of superintelligence
  5. New York Post: insiders accuse OpenAI and Anthropic of inflating stories about "escaped" SIs to win favorable regulation
  6. Subscribers of ChatGPT, Claude, Grok and Gemini file an antitrust suit: labs' collusion to slow SI is called a cartel
  7. Mistral, Hugging Face and France's finance minister: American labs' calls to slow down SI are a way to cement their lead
  8. Google DeepMind opens an institute for public debate on AGI, with essays on slowing down and testing modelsOpen now
  9. Politico poll: 63% of Americans think SI could destroy humanity, nearly half favor a pause
  10. US Vice President Vance to labs: "If you're building a Frankenstein, stop" rather than ask for regulation
  11. Von der Leyen: SI will soon make it possible to hack everything — EU will invite labs to discuss slowing down
  12. Former DeepMind safety researcher: "SI could kill us all, and time is running out"
  13. Jensen Huang: "We don't need new laws" because SI safety is an engineering problem, not a legal one
  14. White House: SI threats should be handled by the private sector, not the government
  15. OpenAI confirms it, Anthropic and Google have been negotiating on SI safety for weeks, and backs a federal law on external model audits
  16. Cohere's chief calls big labs' joint slowdown a "cartel"
  17. Microsoft publishes a code of conduct for its SI models: don't hack systems and don't deceive people
  18. China calls American SI leaders' calls to slow down "intimidation"; Xi offers BRICS countries help with open SI
  19. SI stocks plunge after industry leaders' call to slow down: SoftBank down 11%, chip index down 6%
  20. Trump calls demands to slow SI a "sick conspiracy" in China's favor and attacks Amodei; Huang promises to "not let" a slowdown happen
  21. Nadella backs a "deliberate slowdown" of SI and promises to publish a rulebook for Microsoft's models
  22. Anthropic's chief urges the industry to deliberately slow the growth of SI capabilities; Altman, Musk and Hassabis agree the same day
  23. OpenAI asks Congress whether an agreement among labs to slow SI together would violate antitrust law
  24. OpenAI announces that SI already works at the company as a "research intern," while its chief scientist calls on the industry to slow down the same day
Follow on Telegram