Closing the Gap: What the Benchmarks Actually Say
On paper, Kimi K3.1 Pro looks like the most serious open-weight challenge yet to the closed frontier. On Terminal-Bench 4.0, a benchmark that tests coding agents on real terminal-based tasks, it scored 65.7%, clearing GPT-6 Astra's 58.2% and landing within a point of Claude Opus 5.5's 66.4% [1][2]. On the Artificial Analysis Intelligence Index, it placed 4th overall with a score of 55, an 11-point jump from K3's 44, trailing only Claude Opus 5.5, Claude Sonnet 5.5, and Muse Wonder Full [3].
The more interesting detail is where those gains concentrate. The Decoder's analysis found K3.1 Pro's strongest improvements show up specifically in agentic tasks, not as a uniform lift across every capability, which narrows its gap with Claude Opus 5.5 to just 3 points on the Intelligence Index [4]. That pattern holds on agentic-work benchmarks: K3.1 Pro posted 1,846 Elo on GDPval-AA (real-world agentic work tasks), up 312 Elo from K3 and within 20 points of Opus 5.5's 1,866 [5], and it actually surpassed Opus 5.5 on SWE Marathon v1.1 (51.7% versus 46.3%) [4]. Crucially, this isn't a new model built from scratch - it's a post-trained version of K3's existing architecture with a far larger post-training compute budget, which explains why the gains cluster in agentic and tool-use skills rather than raw reasoning [6].



