AWS and NVIDIA's 2-million-GPU AI infrastructure expansion

NVIDIA's real technical contribution here isn't just more GPUs - it's a redesign of how memory itself works. NVHBM relocates the memory controller out of the compute die entirely and moves it into the base die of the HBM memory stack itself, freeing up silicon area on the processor for more compute logic while increasing memory bandwidth and cutting power draw ^[1]. NVIDIA says the result is up to 30% more memory bandwidth, 15% lower HBM power consumption, and as much as 25% more usable compute-die area compared with standard HBM4E ^[1]. Amazon's chip-design unit, Annapurna Labs, is the first outside partner working with NVIDIA on this technology - notable because Annapurna is the same group that designs AWS's own Trainium processors.

That overlap is the tell. For Trainium4, this NVHBM work sits alongside NVLink Fusion, the interconnect technology AWS first flagged at re:Invent 2025 ^[2]. NVLink Fusion chiplets can connect up to 72 custom ASICs all-to-all at 3.6 TB/s per chip, adding up to 260 TB/s of total scale-up bandwidth through the Vera-Rubin NVLink switch tray ^[2], built on next-generation NVLink 6 running roughly 28 times faster than PCIe Gen5 ^[3]. In practice, AWS's own silicon and NVIDIA's GPUs are being wired into the same physical fabric, not kept as separate product lines competing for the same rack slot.

AWS's own public comments this year cut against the idea that Trainium is meant to dethrone NVIDIA. In a Bloomberg Television interview, AWS CEO Matt Garman said NVIDIA "has a fantastic product" and that "the vast majority of workloads are going to continue to run in Nvidia processors for a long time" - a striking concession from the company spending billions building a competing chip line. ConvergeDigest's read of the new interconnect work backs that up: with NVLink Fusion and NVHBM now built into Trainium4, the relationship between Trainium and NVIDIA GPUs on AWS is "no longer one of competing alternatives in a customer's workload decision, but is becoming, at the silicon level, one architecture" ^[3].

That framing reshapes what the deal actually is. Rather than AWS hedging against NVIDIA dependency, the partnership is being engineered so customers never have to choose - Trainium and NVIDIA GPUs increasingly sit on the same NVLink fabric, share the same rack architecture, and get provisioned as complementary capacity rather than alternatives.

The scale of this reversal is easy to miss if you only read the headline GPU count. AWS's prior commitment - more than 1 million GPUs starting in 2026 - was announced at NVIDIA's GTC 2026 conference and reportedly ran out before its own deployment window even closed ^[4], with Amazon acknowledging simply that "demand has exceeded those expectations" ^[5]. Five months later, AWS and NVIDIA are back with a commitment to deploy 2 million additional Blackwell Ultra, Rubin, and Rubin Ultra GPUs across AWS's global infrastructure during 2027-2028 ^[6].

That's not an isolated spike. Separately, Amazon tripled its overall NVIDIA chip orders to roughly 3 million units, in a deal industry estimates put at "tens of billions of dollars" based on GPU unit costs, even though the companies haven't disclosed terms ^[7]. Amazon's custom chip business has itself crossed a $25 billion annualized revenue run rate, backed by $225 billion in total commitments from AI labs including Anthropic and OpenAI ^[7]. Each of these numbers individually reads as aggressive capacity planning; stacked together, they describe a company that keeps sizing its AI infrastructure bets for a demand curve it hasn't yet managed to overshoot.

Not everyone reacted with the enthusiasm on display in NVIDIA's and AWS's own social channels. The conversation split sharply once it reached stock- and finance-focused corners of Reddit. In r/stocks and r/wallstreetbets, some commenters ran their own modeling: roughly $70 billion in upfront NVIDIA revenue on 2 million GPUs, and - if AWS rents that capacity out at typical cloud pricing over five years - more than $200 billion in downstream AWS revenue, a bullish read on the economics of the deal.

Other threads in the same communities were openly skeptical, framing the arrangement as a symptom of circular AI-infrastructure financing and drawing comparisons to accounting failures from a prior corporate era. Commenters also pointed out that Amazon's stock didn't rally on the announcement despite its headline size, and one thread connected it to NVIDIA's separate multi-hundred-billion-dollar compute-financing arrangements with a group of major asset managers - the suggestion being that NVIDIA is underwriting demand for its own chips on more than one front simultaneously. Tellingly, this skepticism was concentrated in finance-focused subreddits like r/stocks and r/wallstreetbets, where bullish revenue modeling and bubble-comparisons played out side by side in the same threads.

Buried inside the commercial headline is a separate, smaller commitment with different stakes: AWS and NVIDIA will build AI factories for the U.S. government that include 100,000 GPUs on secure AWS infrastructure, classified to meet Impact Level 6 (IL6) and above security requirements ^[5]. IL6 is the classification tier used for the U.S. government's most sensitive workloads - the kind of environment where cloud providers can't simply repurpose commercial data-center capacity.

That a single partnership announcement now spans hyperscale commercial deployment, classified government AI factories, and standardized custom-silicon memory architecture says something about how consolidated AI infrastructure procurement has become. Government workloads classified at Impact Level 6 and above typically demand a stricter security perimeter than ordinary commercial cloud capacity - folding a dedicated 100,000-GPU commitment into the same announcement suggests AWS and NVIDIA are treating classified compute as an extension of the broader buildout rather than a separate initiative negotiated on its own.