Musk: Colossus 2 in Memphis could more than double by year-end to 1.2 million Nvidia chips
Prepared by Sintelligent with the help of SI. Publication time restored from the build log. . Updated: .
Computing power for SI is doubling in a matter of months: the foundation for the next generations of models is already being poured.
The cluster currently has about 550 thousand Nvidia GB200 and GB300 accelerators. According to Musk, another roughly 220 thousand GB300s will come online within a week, the same number in November, and a third batch by the end of December, "if we're lucky". Together with the neighboring Colossus 1, the Memphis site will approach 1.44 million accelerators; this is the most detailed expansion timeline Musk has given publicly. Caveats: chip deliveries and the supply of electricity and cooling could shift the schedule.
Sources 2