Groq was focused on building its own chips, dubbed LPUs (language processing units), to compete with Nvidia on inference — the type of compute needed to run AI workloads in real time. After it lost its star team, Groq shifted from being a pure AI chipmaker into a cloud and data center provider that operates Nvidia systems.
In June, Groq raised a $650 million round to kick off its pivot. Groq intends to scale from 54 megawatts to more than 200 megawatts in 2027.
Today, Groq operates 13 data centers across North America, Europe, the Middle East, and Asia Pacific, serving more than 6 million developers, enterprises, and AI-native companies. Groq says the fresh funds will support “those seeking usage of medium and larger sized clusters of Nvidia accelerated computing for training and inference.”
“We are building Groq into the world’s leading AI inference cloud,” Alex Davis, Groq’s chairman and CEO of Disruptive, said in a statement. “Inference will without a doubt become the largest and most critical layer of AI infrastructure.”
While inference is in high demand as enterprises scale AI workloads, it’s an open question whether neoclouds will be a profitable enough business to provide returns on their considerable investment in the long term. CoreWeave reported strong second-quarter revenue growth and recently landed major contracts, including with Meta and Anthropic. However, investors remained concerned about the company’s high capital expenditures, heavy reliance on debt, and exposure to rapidly depreciating hardware, and its ability to turn growth into free cash flow.
Groq’s financials are still private for now, but its pivot puts the company directly inside Nvidia’s AI infrastructure ecosystem. That’s not exactly a unique relationship among neoclouds today. Nvidia supplies the GPUs powering clouds from CoreWeave, Lambda, and Nebius, while also investing billions into some of those companies as they race to build more capacity.
TechCrunch has reached out to Groq for more information.
