Former Anthropic researcher Coxon on NBC: the "kill switch" for SI may soon stop working
Prepared by Sintelligent with the help of SI. Publication time restored from the build log. . Updated: .
People inside the labs say the "kill switch" for SI may soon stop working, and yet ask not to rush into strict laws: law is becoming outdated faster than new models are released.
Jacob Coxon, who left Anthropic with a warning about self-improving SI, said on Meet the Press that Congress should for now let the leading labs regulate themselves, believing their leaders are "completely sincere" in wanting to slow down. The kill switch, he said, will work on current models while they run in centralized data centers, but "very soon" could become useless if a swarm of agents spreads across the internet. "The people building SI sincerely believe it could kill us all by the end of the decade. This is not a marketing ploy."
Sources 2