xAI Colossus 2 Scales Up

Elon Musk has confirmed that xAI’s Colossus 2 is currently training 7 models concurrently. The models include variations of 1T, 1.5T, 6T, and 10T parameters, along with Imagine V2. The pre-training phase for the 10T model is estimated at approximately 2 months.

Source: Elon Musk on X