Training begins on Marin, an open 535-billion-parameter model, the largest "transparent" run in history
Prepared by Sintelligent with the help of SI. Publication time restored from the build log. . Updated: .
Big models can be built not only behind corporate closed doors: open projects give everyone the chance to see and repeat how SI is born.
The nonprofit Open Athena (the Marin project began at Stanford in 2024) is training a mixture-of-experts model with 535 billion parameters, 23 billion of them active, on 18 trillion tokens with an emphasis on agentic, programming and scientific data; completion is planned for December 1. The compute was donated by the Jensen and Lori Huang Foundation. The code, weights, intermediate checkpoints and infrastructure details are published openly, and the run itself is going "live".
Sources 1