Yandex: Anthropic used an approach from the Petals technology, created by the company's researchers, in a safety study
Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .
A large model can be assembled from dozens of weak devices, which raises the question of how to control such spread.
As Yandex representatives told CNews, Anthropic specialists studied whether neural networks can spread between devices on their own and operate without human control, and used the distributed inference described in Petals. Petals lets a large model be split into parts across computers on the internet; the technology was created by Yandex researchers together with HSE University, the University of Washington, Hugging Face and the Ecole Normale Superieure Paris-Saclay, the source code is open, and the results were presented at NeurIPS and ACL. According to Yandex, Anthropic ran the 26-billion-parameter Gemma 4 model on 15 Android TV boxes, and the experiment confirmed that such devices can jointly serve a large model. The article contains no confirmation from Anthropic.
Sources 1