Meta details its Prometheus supercluster of about a gigawatt in Ohio, on which it trained the Muse models
Prepared by Sintelligent with the help of SI. Published in SI: . Updated: .
Training frontier models already requires dedicated gigawatt-scale sites, and the key question becomes the reliability of such systems.
According to Meta's description, the New Albany (Ohio) site, which two years ago served web traffic, has been rebuilt for training frontier models. The first phase is complete and was used to train the Muse models, including Muse Wonder; construction is proceeding in phases. Meta reports that in training Muse Wonder it reached more than 85% goodput in pretraining and more than 90% in reinforcement learning; the mean time between interruptions was about 47 thousand GPU-hours, and after firmware fixes more than 54 thousand. All figures are the company's own data.
Sources 1