Microsoft's Maia 300 AI inference chip and its challenge to Nvidia

Microsoft is building Maia 300 to run inference for its own products - Copilot, GitHub Copilot, and Microsoft Foundry - and has confirmed no plans to open it to outside Azure customers ^[4]. That is a deliberate break from how its rivals treat custom silicon: Amazon rents Trainium capacity to outside customers, and Google's TPUs are increasingly offered as an alternative to Nvidia GPUs inside their respective clouds. Microsoft is choosing not to compete for that rental business at all.

The split matters because it tells you what Maia 300 is actually for. Coverage of the launch frames it as an inference-only workhorse - frontier model training, the most compute-hungry and highest-margin workload, is expected to stay on Nvidia hardware for the foreseeable future. By absorbing the growing inference load from Copilot and GitHub Copilot onto its own silicon, Microsoft frees up scarce Nvidia GPUs that would otherwise be tied up serving internal traffic, making more of that supply available to sell or lease to paying Azure customers. In other words, Maia 300 isn't primarily about replacing Nvidia - it's about improving the margin on inference Microsoft already has to run anyway, while keeping Nvidia as the partner of record for training the most demanding models.

Microsoft's own figures are the ones doing the persuading: 40% more inference tokens per megawatt than leading GPU-based systems, and up to 7x the rack-scale token throughput of the previous-generation Maia 200 in a full configuration ^[1]. The chip itself carries 950 watts of TDP per accelerator, fed by eight HBM4 stacks delivering 18.0 TB/s of peak memory bandwidth, built around a multi-chiplet design that separates compute, memory-controller, and I/O functions - with the compute chiplets manufactured on TSMC's N2P process node ^[2]. A full rack holds 96 of these accelerators, drawing roughly 167 kilowatts and offering 27.6 TB of HBM capacity with 1.7 PB/s of aggregate bandwidth ^[1].

Put next to Nvidia's current flagship rack - the GB300, which packs 72 GPUs into 142 kilowatts ^[4]- Maia 300's rack trades a higher power draw for a third more accelerators per rack, a bet that density beats efficiency-per-chip at this stage of the inference race. Whether 40% more tokens per megawatt is a modest step or a genuine leap split technical audiences: discussion on the enthusiast forum r/accelerate pushed back on framing the jump as merely incremental, noting that a 40 to 70 percent per-watt efficiency gain is historically rare for a single hardware generation - suggesting the marketing may actually be underselling the result rather than overselling it.

None of this works without TSMC, which manufactures the Maia 300 compute chiplets on its N2P node ^[2]and is reportedly in discussions with Microsoft to produce more than 300,000 Maia chips in 2027 alone ^[3]- a number that could exceed a million units once the multi-gigawatt deployment plans are fully realized ^[4]. Wedbush analyst Matt Bryson argues a Microsoft order at that scale would flow through to chip designer Marvell Technology as well as TSMC, naming both as the clearest beneficiaries if Maia 300 achieves real volume ^[3].

Bryson's read on Nvidia itself is more measured: he does not expect Nvidia to feel much near-term pain, citing its supply advantages and the strength of its software ecosystem ^[3]. That tempers the 'Nvidia killer' framing circulating elsewhere - the more precise read is that every dollar Microsoft spends building its own silicon is a dollar it does not spend buying Nvidia's, set against a backdrop where Microsoft's own capital spending guidance already tops $175 billion for the current fiscal year, alongside comparable custom-silicon programs at Google, Amazon, and OpenAI ^[4]. This looks like a slow redirection of marginal spend, not a near-term swap of suppliers.

Microsoft's chip ambitions have missed their marks before. Independent analysis notes that Maia 100 shipped only in limited volume, and Maia 200 - the generation Maia 300 is meant to succeed - arrived late and was deployed narrowly, which means the 2027 multi-gigawatt volumes Microsoft is now promising remain a plan rather than a confirmed shipment schedule ^[5].

That history fuels a skeptical thread running through investor-focused discussion of the launch, where commenters repeatedly reached for Microsoft's track record of hardware bets that fizzled - Windows Phone, Zune - as a cautionary comparison, even as others pushed back that the comparison overstates Zune's actual failure. One commenter also noted that Microsoft's stock has already run from around $350 in June to over $540 by the time of the announcement, implying the market may have priced in a move like this well before the keynote, and another questioned the urgency of the push given that Microsoft is reportedly still sitting on a meaningful stockpile of idle Nvidia hardware. None of that disproves the technical story Maia 300 tells about tokens per megawatt - but it is a reminder that announcing multi-gigawatt plans for 2027 is a promise, not a delivery.