Elon Musk informed buyers this month that his startup xAI is planning to construct a supercomputer by the autumn of 2025 that will energy a future, smarter iteration of its Grok chatbot, The Info stories. This supercomputer, which Musk reportedly known as a “gigafactory of compute,” would depend on tens of hundreds of NVIDIA H100 GPUs and value billions of {dollars} to construct. Musk has beforehand stated the third model of Grok would require a minimum of 100,000 of the chips — a fivefold enhance over the 20,000 GPUs stated to be in use for coaching Grok 2.0.
In response to The Info, Musk additionally informed buyers within the presentation that the deliberate GPU cluster could be a minimum of 4 instances the dimensions of something used at this time by xAI opponents. Grok is at the moment in model 1.5, which was launched in April, and is now touted to course of visible info like pictures and diagrams in addition to textual content. X earlier this month began rolling out AI-generated information summaries powered by Grok for premium customers.
