Yandex open-sources AliceAI-Foundation, its first model trained entirely from scratch
Prepared by Sintelligent with the help of SI. Publication time restored from the build log. . Updated: .
Russia now has its own open model built from scratch that any developer can take and fine-tune.
AliceAI-Foundation-80B-A3B-Base is a mixture-of-experts model with 80 billion parameters, of which 3 billion are active per token; it was trained on 18 trillion tokens without anyone else's open weights, with a 262 thousand-token context. By Yandex's measurements, it outperforms the larger DeepSeek-V4-Flash-Base and Nemotron-3-Super on factual tasks, including on Russian culture and history, and leads among open base models in olympiad math (IMO AnswerBench) and code; at the same time it has almost three times fewer parameters and about 7 times fewer active ones than the earlier Alice AI LLM 235B. The weights, the report and two new benchmarks (WikiWebFacts and HardMultiQA) are published on Hugging Face under Apache 2.0; the model will serve as the basis for a future reasoning version and for Alice's agents.
Sources 2