DATE: SATURDAY, AUGUST 29, 2026
★ SPECIAL PRINT EDITION ★
SECTION: AI

Nvidia’s AI advantage is moving beyond the GPU

Nvidia’s AI advantage is moving beyond the GPU

Aug 29, 2026 - 19:00
0
Nvidia’s AI advantage is moving beyond the GPU
Listen to Story ~2m
Translate Article
0:00 Ready 0:00
Key Highlights:
  • Before this week, the dominant story about Nvidia went something like this: For the first few years of the AI boom, Nvidia was the only
  • It’s a compelling story, and mostly true. After growing its market cap 10x between the start of 2023 and mid-2025, Nvidia shares have b
  • As AI’s compute grows into the gigawatt scale, orchestration has become an increasingly complex task. Not surprisingly, Nvidia has buil

Before this week, the dominant story about Nvidia went something like this: For the first few years of the AI boom, Nvidia was the only source for state-of-the-art GPUs, which became immensely profitable as the industry scaled out. In the last few years, hyperscalers like Amazon and Google have started building their own chips, and Nvidia is no longer the only game in town, leading many investors to wonder how durable its advantage really is.

It’s a compelling story, and mostly true. After growing its market cap 10x between the start of 2023 and mid-2025, Nvidia shares have been on a more modest trajectory for the past year, driven A new narrative has taken shape since the company’s earnings on Wednesday and investors are starting to realize that Nvidia’s advantage goes far beyond GPUs.

Core Findings and Detailed Timeline

As AI’s compute grows into the gigawatt scale, orchestration has become an increasingly complex task. Not surprisingly, Nvidia has built much of the state-of-the-art hardware needed to handle it, giving the company a huge advantage in the systems that surround the GPU even as it sees increased competition on the GPUs themselves.

For all the talk of compute as a commodity, it’s still incredibly difficult to operate a megascale data center at peak efficiency — and as deployments get bigger and faster, that challenge is only growing.

You can see some of this just The company is currently rolling out its Vera Rubin architecture, which pairs the Rubin GPU with a collection of other units, including the Vera CPU, the Groq 3 LPX inference accelerator and similar racks for storage and networking. Over the past week, I’ve been talking to folks at Nvidia about what those systems actually do, and the results have been surprising.

Like the Rubin GPU itself, they’re extremely specialized systems, but instead of churning through tokens, they’re making sure everything outside the GPU works as efficiently as possible. If the GPU is the engine, these are the rest of the car. The Vera CPU in particular is focused on the problem of orchestrating data.

Broader Implications and Future Outlook

“Vera is important because there’s only so much memory that you can put in a single server or any sort of compute platform,” Jason Hardy, Nvidia’s VP of storage technology, told me. As data centers have scaled up computing power, memory capacity has scaled up too, which is why companies like Micron have gotten rich in the second wave of the infrastructure boom.

Read More: AI Researchers Develop Automated System to Improve Model Performance

But getting that data to the GPU at the right time isn’t straightforward — and as companies look to drive tokens-per-watt lower and lower, they’re realizing how important that kind of traffic direction is. “We saw upwards of 3x improvement in these operations, where the Vera CPU is allowing for acceleration,” Hardy said.

“So now we can use our flash to its fullest potential, because we can get all that performance out of it without bottlenecking.” You can see versions of the same problem outside of Nvidia.

When OpenAI developed its Jalapeño chip, a major focus was avoiding these challenges entirely “We designed Jalapeño to minimize data movement and communication delays,” the company said in a blog post earlier this month. “Its large domain allows the entire workload to remain within one connected system, minimizing data movement and helping the complete request stay fast and efficient from beginning to end.” It’s a different approach, avoiding data movement entirely But the overall logic is the same, increasing efficiency with smarter traffic control instead of just more processor cycles.

That in turn opens up a whole new layer of infrastructure for companies to compete over. This new focus on data orchestration isn’t automatically a win for Nvidia. The company will have to compete with rival chipmakers and hyperscalers just as it has with GPUs.

But the competition has moved to a new layer, where building a rival GPU matters less than being able to make the entire system work efficiently. And at least in the early stages, Nvidia looks to have a commanding lead. When you purchase through links in our articles, we may earn a small commission.

This doesn’t affect our editorial independence. Don’t miss out. The startup community will gather to answer a pivotal question: How do you build sustainably in the AI era?

Hugging Face is selling a cute $399 open source duck robot, Microduck Nvidia closes in on Hugging Face acquisition Fitbit founders launch Luffu Link, an LTE health and safety band Hugging Face reportedly in talks to be acquired for $13B Who’s behind the new ‘stealth model’ Ox Alpha? Flock CEO calls for ‘compromise’ as surveillance company faces growing backlash Two years after launch, Walmart’s Flipkart is closing in on India’s quick-commerce leaders

Frequently Asked Questions

Before this week, the dominant story about Nvidia went something like this: For the first few years of the AI boom, Nvidia was the only source for state-of-the-art GPUs, which became immensely profitable as the industry scaled out.

“So now we can use our flash to its fullest potential, because we can get all that performance out of it without bottlenecking.” You can see versions of the same problem outside of Nvidia.

What's Your Reaction?

Like Like 1
Dislike Dislike 0
Love Love 0
Funny Funny 0
Wow Wow 2
Sad Sad 0
Angry Angry 0

Tech journalist and AI enthusiast who enjoys keeping up with the latest in hardware, processors, emerging AI tools, and software. I like digging into new technology, understanding how things actually work, and following the developments that could shape the way we use technology in the future.

Comments (0)

User