Groq now wants to sell cloud rather than just chips
Groq is pursuing a major strategic transformation. Long seen as one of Nvidia’s challengers thanks to its LPUs (Language Processing Units) specialised in artificial intelligence model inference, the group is now focusing its efforts on GroqCloud, its cloud infrastructure dedicated to running AI models. This shift is part of a broader trend, that of neoclouds: specialist providers that build their infrastructure around the very specific needs of artificial intelligence rather than offering the vast catalogue of general-purpose services of AWS, Microsoft Azure or Google Cloud. Groq’s repositioning is already well under way: in June 2026 the company announced that it was operating 13 data centres across North America, Europe, the Middle East and Asia-Pacific, with more than five million developers using its infrastructure.¹
The shift to the neocloud was already in the making
Groq did not discover the cloud in 2026, since GroqCloud was launched back in 2024 following the acquisition of Definitive Intelligence, but its positioning has changed profoundly since then.² The non-exclusive licensing agreement signed with Nvidia in December 2025 was a turning point: Nvidia obtained a licence for some of Groq’s inference technologies, while founder Jonathan Ross, president Sunny Madra and several team members joined the GPU giant, with Groq remaining an independent company.³ In the following months, the company refocused its organisation around a much clearer ambition: to become a major cloud provider specialising in AI inference. This change is gradually transforming Groq from a player mainly identified with its hardware into a company selling computing capacity and inference services directly to developers and organisations.
Inference becomes the new jackpot of AI infrastructure
This strategy rests on a strong conviction: once models have been trained, their day-to-day use could require far more resources than their initial training. Groq estimates that inference could eventually require 15 to 20 times more computing capacity than training, particularly as conversational assistants, generative applications and autonomous agents that continuously send requests multiply.¹ The challenge is therefore no longer just to build the most powerful models, but to be able to run them quickly, at scale and at a cost low enough to make their use economically viable. Groq wants to occupy precisely this space with infrastructure optimised for real-time inference, and according to the company its cloud already processes several trillion tokens every week.
Neoclouds want to carve out a place alongside the hyperscalers
Groq is thus joining a market in which specialist players such as CoreWeave and Together AI are seeking to offer an alternative to the major cloud providers. The neocloud principle consists of building much more specialised infrastructure around AI workloads, with accelerators, networks and software optimised for training or inference, rather than trying to cover all of a company’s IT needs. The phenomenon is attracting massive amounts of capital: Together AI, for example, raised $800 million in July 2026, while several other specialist providers have completed major funding rounds in recent months.⁴ This momentum shows that the market expects a genuine layer of AI-specialised cloud to emerge, complementing or competing with the infrastructure offered by the hyperscalers.
For businesses, a new option emerges alongside AWS, Azure and Google Cloud
The appeal of neoclouds is particularly tangible for companies deploying artificial intelligence applications at scale. They may be looking for infrastructure offering more specialised capacity, lower latency or pricing better suited to their workloads, without necessarily moving their entire information system to a new provider. Groq highlights in particular the speed and cost-efficiency of its infrastructure for real-time inference applications, and its international expansion aims to bring computing capacity closer to users in order to reduce latency and meet certain data sovereignty requirements. In Australia, for example, Groq and Equinix announced a 4.5 MW infrastructure to deliver its inference services locally.⁵
Cloud Computing enters the era of specialised infrastructure
This transformation also shows how Cloud Computing skills are evolving. Cloud architects will no longer simply have to choose between AWS, Azure and Google Cloud, but may need to combine several providers depending on the nature of workloads, available hardware, data location, latency and the cost of inference. The rise of neoclouds therefore adds a new layer of complexity to multi-cloud architectures: a company could keep its business applications with a hyperscaler while running certain AI models on specialised infrastructure. Understanding distributed architectures, how AI accelerators work, inference APIs and data movement mechanisms then becomes essential to decide which infrastructure to use for each workload.
The battle for the AI cloud is only just beginning
Ultimately, Groq’s repositioning shows that the artificial intelligence revolution is not being played out solely between the labs developing the models. Another competition is taking place in data centres, where enough capacity must be built to run these models at scale while keeping their cost under control. Groq notably plans to continue expanding its infrastructure towards 200 MW by the end of 2027, a sign that its future now largely depends on operating a global inference platform.¹ Facing the hyperscalers and a new generation of extremely well-funded neoclouds, the question now is whether Groq can turn its long-standing expertise in AI accelerators into a genuine competitive advantage in the cloud.
360° IT News — decoding technology to understand the jobs of tomorrow.
Further reading
The infrastructure needed for artificial intelligence is also transforming traditional cloud architectures. Read our CCCLX article “The cloud prepares for autonomous agents: AWS evolves Lambda”, which analyses how AWS is adapting its serverless infrastructure to new agentic workloads.
References
1. Groq. (2026). Groq Raises $650M to Scale Its AI Inference Cloud Business.
https://groq.com/newsroom/groq-raises-usd650m-to-scale-its-ai-inference-cloud-business
2. Groq. (2024). Groq Acquires Definitive Intelligence to Launch GroqCloud.
https://groq.com/newsroom/groq-acquires-definitive-intelligence-to-launch-groqcloud
3. Groq. (2025). Groq and Nvidia Enter Non-Exclusive Inference Technology Licensing Agreement to Accelerate AI Inference at Global Scale.
https://groq.com/newsroom/groq-and-nvidia-enter-non-exclusive-inference-technology-licensing-agreement-to-accelerate-ai-inference-at-global-scale
4. TechCrunch. (2026). Neocloud Together AI raises $800M, leaps to $8.3B valuation.
https://techcrunch.com
5. Groq. (2025). Groq Expands to Asia-Pacific with Sydney Data Center to Power the Next Generation of AI Inference.
https://groq.com
GitHub Copilot bulks up for business: coding agents come under IT control
Copilot is no longer just there to suggest the next line GitHub Copilot is continuing its transformation. Originally known mainly for completing code in the editor, the tool is now evolving towards agents capable of exploring a project, modifying files, using tools...
PDFs, presentations, audio: Adobe wants to turn Acrobat into a content factory
Acrobat no longer just wants to open your documents For more than thirty years, Acrobat has mainly been used to read, create, edit, sign and share PDFs. Adobe now wants to give it a much broader role. On 9 September 2026, the company announced new capabilities based...
Salesforce plugs Claude into its CRM: Claudeforce prepares for life after the interface
What if the CRM soon no longer needed to be opened? For decades, using a CRM meant navigating between customer records, dashboards, menus and forms. With Claudeforce, Salesforce and Anthropic want to change this logic: rather than forcing users to go into Salesforce...
Kimi K3, Mistral, DeepSeek: Oracle turns OCI into an AI model hub
Oracle wants to make OCI a one-stop shop for AI Oracle is stepping up its efforts in the AI cloud battle by significantly expanding the catalogue of models available in OCI Enterprise AI. On 4 September 2026, the group announced in particular the integration of Kimi...
Agentic Data Cloud: Google rethinks data for the age of AI agents
AI agents are forcing Google to rethink data architecture AI agents promise to search for information, make decisions and act directly within company systems, but this autonomy depends on one essential condition: accessing the right data and, above all, understanding...
Google Cloud tackles the hidden bill of AI agents
AI agents raise a new problem: how much does a task really cost? As companies move from chatbots to AI agents able to work through multiple steps, the question of cost becomes much more complex. A chatbot generally handles a request and generates an answer, whereas an...
Workday, Navan, Avalara: ChatGPT Work moves into business software
ChatGPT Work is gradually leaving the chat window With GPT-6 Astra, OpenAI is no longer simply trying to improve the quality of ChatGPT’s answers. The company wants to bring its AI closer to the applications in which employees actually work. With the arrival of GPT-6...
Muse Code: Meta launches its AI agent to tackle giant codebases
Meta wants to bring AI agents into complex software projects Meta is stepping up its efforts in AI-assisted software development with Muse Code, a new agent designed to work on large codebases, where traditional assistants can quickly lose the context needed to...
Qwen3.8-Max reportedly coded for 16 days without human intervention
Alibaba tests how far an autonomous AI developer can go Alibaba claims to have reached a new milestone in agentic software development with Qwen3.8-Max, its new flagship model launched in early August 2026. In an internal test, the model reportedly worked fully...
Two months, $1.1 billion: River AI is already exciting investors
A spectacular raise for a start-up barely out of the shadows Two months after emerging from stealth mode, River AI has just completed one of the most spectacular funding rounds of the year in artificial intelligence. The start-up founded by Igor Babuschkin, a former...
