Musk’s xAI Taps NVIDIA to Expand Grok Using ‘World’s Largest AI Supercomputer’

Chipmaker Nvidia introduced Monday that its Spectrum-X networking know-how has helped increase startup xAI’s Colossus supercomputer, now acknowledged as the most important AI coaching cluster on this planet. 

Positioned in Memphis, Tennessee, Colossus serves because the coaching floor for the third technology of Grok, xAI’s suite of enormous language fashions developed to energy chatbot options for X Premium subscribers.

Colossus, completed in simply 122 days, started coaching its first fashions 19 days after set up. Tech billionaire Elon Musk’s startup xAI plans to double the system’s capability to 200,000 GPUs, Nvidia mentioned in a statement on Monday.

At its core, Colossus is a huge interconnected system of GPUs, every specialised in processing giant datasets. When Grok fashions are educated, they should analyze monumental quantities of textual content, pictures, and knowledge to enhance their responses. 

Touted by Musk as essentially the most highly effective AI coaching cluster on this planet, Colossus connects 100,000 NVIDIA Hopper GPUs utilizing a unified Distant Direct Reminiscence Entry community. Nvidia’s Hopper GPUs deal with advanced duties by separating the workload throughout a number of GPUs and processing it in parallel.

The structure permits knowledge to maneuver immediately between nodes, bypassing the working system and making certain low latency in addition to optimum throughput for in depth AI coaching duties.

Whereas conventional Ethernet networks typically endure from congestion and packet loss—limiting throughput to 60%—Spectrum-X achieves 95% throughput with out latency degradation. 

Spectrum-X permits giant numbers of GPUs to speak extra easily with each other, as conventional networks can get slowed down with an excessive amount of knowledge. 

The know-how permits Grok to be educated quicker and extra precisely, which is crucial for constructing AI fashions that reply successfully to human interactions.

Monday’s announcement had little impact on Nvidia’s inventory, which dipped barely. Shares traded at $141 as of Monday, with the corporate’s market cap at $3.45 trillion.

Edited by Sebastian Sinclair