From miles away across the desert, the Great Pyramid looks like a perfect, smooth geometry — a sleek triangle pointing to the stars. Stand at the base, however, and the illusion of smoothness vanishes. You see massive, jagged blocks of limestone. It is not a slope; it is a staircase.
Remember this the next time you hear futurists talking about exponential growth.
Intel’s co-founder Gordon Moore (Moore’s Law) is famously quoted for saying in 1965 that the transistor count on a microchip would double every year. Another Intel executive, David House, later revised this statement to “compute power doubling every 18 months.” For a while, Intel’s CPUs were the poster child of this law. That is, until the growth in CPU performance flattened out like a block of limestone.
If you zoom out, though, the next limestone block was already there — the growth in compute merely shifted from CPUs to the world of GPUs. Jensen Huang, Nvidia’s CEO, played a long game and came out a strong winner, building his own stepping stones initially with gaming, then computer visioniand recently, generative AI.
The illusion of smooth growth
Technology growth is full of sprints and plateaus, and gen AI is not immune. The current wave is driven by transformer architecture. To quote Anthropic’s President and co-founder Dario Amodei: “The exponential continues until it doesn’t. And every year we’ve been like, ‘Well, this can’t possibly be the case that things will continue on the exponential’ — and then every year it has.”
But just as the CPU plateaued and GPUs took the lead, we are seeing signs that LLM growth is shifting paradigms again. For example, late in 2024, DeepSeek surprised the world by training a world-class model on an impossibly small budget, in part by using the MoE technique.
Do you remember where you recently saw this technique mentioned? Nvidia’s Rubin press release: The technology includes “…the latest generations of Nvidia NVLink interconnect technology… to accelerate agentic AI, advanced reasoning and massive-scale MoE model inference at up to 10x lower cost per token.”
Jensen knows that achieving that coveted exponential growth in compute doesn’t come from pure brute force anymore. Sometimes you need to shift the architecture entirely to place the next stepping stone.
The latency crisis: Where Groq fits in
This long introduction brings us to Groq.
The biggest gains in AI reasoning capabilities in 2025 were driven by “inference time compute” — or, in lay terms, “letting the model think for a longer period of time.” But time is money. Consumers and businesses do not like waiting.
Groq comes into play here with its lightning-speed inference. If you bring together the architectural efficiency of models like DeepSeek and the sheer throughput of Groq, you get frontier intelligence at your fingertips. By executing inference faster, you can “out-reason” competitive models, offering a “smarter” system to customers without the penalty of lag.
From universal chip to inference optimization
For the last decade, the GPU has been the universal hammer for every AI nail. You use H100s to train the model; you use H100s (or trimmed-down versions) to run the model. But as models shift toward “System 2” thinking — where the AI reasons, self-corrects and iterates before answering — the computational workload changes.
Training requires massive parallel brute force. Inference, especially for reasoning models, requires faster sequential processing. It must generate tokens instantly to facilitate complex chains of thought without the user waiting minutes for an answer. Groq’s LPU (Language Processing Unit) architecture removes the memory bandwidth bottleneck that plagues GPUs during small-batch inference, delivering lightning-fast inference.
The engine for the next wave of growth
For the C-Suite, this potential convergence solves the “thinking time” latency crisis. Consider the expectations from AI agents: We want them to autonomously book flights, code entire apps and research legal precedent. To do this reliably, a model might need to generate 10,000 internal “thought tokens” to verify its own work before it outputs a single word to the user.
-
On a standard GPU: 10,000 thought tokens might take 20 to 40 seconds. The user gets bored and leaves.
-
On Groq: That same chain of thought happens in less than 2 seconds.
If Nvidia integrates Groq’s technology, they solve the “waiting for the robot to think” problem. They preserve the magic of AI. Just as they moved from rendering pixels (gaming) to rendering intelligence (gen AI), they would now move to rendering reasoning in real-time.
Furthermore, this creates a formidable software moat. Groq’s biggest hurdle has always been the software stack; Nvidia’s biggest asset is CUDA. If Nvidia wraps its ecosystem around Groq’s hardware, they effectively dig a moat so wide that competitors cannot cross it. They would offer the universal platform: The best environment to train and the most efficient environment to run (Groq/LPU).
Consider what happens when you couple that raw inference power with a next-generation open source model (like the rumored DeepSeek 4): You get an offering that would rival today’s frontier models in cost, performance and speed. That opens up opportunities for Nvidia, from directly entering the inference business with its own cloud offering, to continuing to power a growing number of exponentially growing customers.
The next step on the pyramid
Returning to our opening metaphor: The “exponential” growth of AI is not a smooth line of raw FLOPs; it is a staircase of bottlenecks being smashed.
-
Block 1: We couldn’t calculate fast enough. Solution: The GPU.
-
Block 2: We couldn’t train deep enough. Solution: Transformer architecture.
-
Block 3: We can’t “think” fast enough. Solution: Groq’s LPU.
Jensen Huang has never been afraid to cannibalize his own product lines to own the future. By validating Groq, Nvidia wouldn’t just be buying a faster chip; they would be bringing next-generation intelligence to the masses.
Andrew Filev, founder and CEO of Zencoder
Welcome to the VentureBeat community!
Our guest posting program is where technical experts share insights and provide neutral, non-vested deep dives on AI, data infrastructure, cybersecurity and other cutting-edge technologies shaping the future of enterprise.
Read more from our guest post program — and check out our guidelines if you’re interested in contributing an article of your own!
![Heathrow has said passenger numbers were 60% lower in November than before the coronavirus pandemic and there were “high cancellations” among business travellers concerned about being trapped overseas for Christmas as Omicron spreads. The UK’s largest airport said the government’s travel restrictions had dealt a fresh blow to travel confidence and predicted it was likely to take several years for passenger numbers to return to pre-pandemic levels. This week ministers said passengers arriving in the UK would have to take a pre-departure Covid test, as well as a post-flight test, because of fears about the spread of the new variant. “[The] high level of cancellations by business travellers concerned about being trapped overseas because of pre-departure testing shows the potential harm to the economy of travel restrictions,” the airport said in an update. Heathrow said the drop in traveller confidence owing to the new travel restrictions had negated the benefit of reopening the all-important corridor to North America for business and holiday travel last month. Eleven African countries have been added to the government’s red list, requiring travellers to quarantine before reuniting with families. “By allowing Brits to isolate at home, ministers can make sure they are reunited with their loved ones this Christmas,” said John Holland-Kaye, the chief executive of Heathrow. “It would send a strong signal that restrictions on travel will be removed as soon as safely possible to give passengers the confidence to book for 2022, opening up thousands of new jobs for local people at Heathrow. Let’s reunite families for Christmas.” Heathrow said that if the government could safely signal that restrictions would be lifted soon, then employers at Heathrow would have the confidence to hire thousands of staff in anticipation of a boost in business next summer. The airport is expecting a slow start to 2022, finishing next year with about 45 million passengers – just over half of pre-pandemic levels. This week Tui, Europe’s largest package holiday operator, said it expected bookings for next summer to bounce back to 2019 levels. However, Heathrow said on Friday not to expect the aviation industry to recover for several years. “We do not expect that international travel will recover to 2019 levels until at least all travel restrictions (including testing) are removed from all the markets that we serve, at both ends of the route, and there is no risk of new restrictions, such as quarantine, being imposed,” the airport said.](https://wordupnews.com/wp-content/uploads/2026/02/shutterstock_1100012546-scaled-400x240.jpg)
![Heathrow has said passenger numbers were 60% lower in November than before the coronavirus pandemic and there were “high cancellations” among business travellers concerned about being trapped overseas for Christmas as Omicron spreads. The UK’s largest airport said the government’s travel restrictions had dealt a fresh blow to travel confidence and predicted it was likely to take several years for passenger numbers to return to pre-pandemic levels. This week ministers said passengers arriving in the UK would have to take a pre-departure Covid test, as well as a post-flight test, because of fears about the spread of the new variant. “[The] high level of cancellations by business travellers concerned about being trapped overseas because of pre-departure testing shows the potential harm to the economy of travel restrictions,” the airport said in an update. Heathrow said the drop in traveller confidence owing to the new travel restrictions had negated the benefit of reopening the all-important corridor to North America for business and holiday travel last month. Eleven African countries have been added to the government’s red list, requiring travellers to quarantine before reuniting with families. “By allowing Brits to isolate at home, ministers can make sure they are reunited with their loved ones this Christmas,” said John Holland-Kaye, the chief executive of Heathrow. “It would send a strong signal that restrictions on travel will be removed as soon as safely possible to give passengers the confidence to book for 2022, opening up thousands of new jobs for local people at Heathrow. Let’s reunite families for Christmas.” Heathrow said that if the government could safely signal that restrictions would be lifted soon, then employers at Heathrow would have the confidence to hire thousands of staff in anticipation of a boost in business next summer. The airport is expecting a slow start to 2022, finishing next year with about 45 million passengers – just over half of pre-pandemic levels. This week Tui, Europe’s largest package holiday operator, said it expected bookings for next summer to bounce back to 2019 levels. However, Heathrow said on Friday not to expect the aviation industry to recover for several years. “We do not expect that international travel will recover to 2019 levels until at least all travel restrictions (including testing) are removed from all the markets that we serve, at both ends of the route, and there is no risk of new restrictions, such as quarantine, being imposed,” the airport said.](https://wordupnews.com/wp-content/uploads/2026/02/shutterstock_1100012546-scaled-80x80.jpg)
