How Moonshot Built a Frontier Model Without Frontier Chips
Kimi K3 is Moonshot AI's largest model yet: 2.8 trillion total parameters spread across 896 experts, of which only 16 activate per token - roughly 1.8% of the pool. Layer that mixture-of-experts design on top of Kimi Delta Attention, a hybrid linear-attention mechanism paired with Attention Residuals, and the result is a model with native vision and a 1-million-token context window that still runs at a fraction of the compute a dense model this size would require [1].
That efficiency-first design is being read as more than an engineering choice. Coverage has framed the sparse activation pattern as Moonshot's way of maximizing capability under the compute ceiling U.S. export controls impose on Chinese labs, rather than simply buying more chips [2]. The payoff shows up in the numbers: K3 posted a GDPval-AA v2 score of 1,687 - third place, just behind Claude Fable 5 Max (1,815) and GPT-5.6 Sol Max (1,747.8) - and an Artificial Analysis Intelligence Index score of 57 [3]. It also topped the Frontend Code Arena outright, beating Claude Fable 5 in blind developer testing on web coding tasks [2].




