Inside Elon Musk's supercomputer
xAI Colossus is the world's largest AI cluster, created to train the Grok chatbot.
It currently has exabytes of storage and 100,000 Nvidia H100 GPUs worth about $3 billion.
They plan to double that number by the end of the year, adding more advanced H200s, and triple it by the summer of 2025.