NVIDIA AVO agent harness scores 100% on ARC-AGI-3
TECH

NVIDIA AVO agent harness scores 100% on ARC-AGI-3

29+
Signals

Strategic Overview

  • 01.
    NVIDIA's AVO agent system achieved a perfect 100.00 RHAE score on ARC-AGI-3, completing all 183 levels across all 25 public game environments.
  • 02.
    The bare Claude Opus 5 model, without the AVO harness, scores only about 30.2% on the same ARC-AGI-3 public set.
  • 03.
    AVO completed the 183 levels using 6,624 total environment actions, about 12% fewer than VISTA, a rival Claude-Opus-5-based system that needed 7,542 actions.
  • 04.
    The 100% figure covers only the public set, was self-reported by NVIDIA using its own reimplementation of the task interface, and is not a verified entry on the official ARC Prize leaderboard.

Deep Analysis

The Harness Did What The Model Couldn't

The Harness Did What The Model Couldn't
AVO's four-part architecture converted a 30% bare-model score into a perfect 100% on ARC-AGI-3's public set.

NVIDIA's AVO (Agentic Variation Operators) system posted a perfect 100.00 score on ARC-AGI-3, completing all 183 levels across the benchmark's 25 public environments [1]. The striking part isn't the score itself, it's the delta: the same underlying model, Anthropic's Claude Opus 5, manages only about 30.2% when tested bare, with no surrounding system around it [2]. AVO is not a new or fine-tuned model, it's a general-purpose software harness wrapped around Opus 5, and NVIDIA's own framing is blunt about what that implies: 'The model is only one component of an agent, and the harness around it - memory, tool use, recovery from failure, sustained context across a long task - is what determines whether that underlying capability translates into completed levels.' [3]Reaction on Reddit converged on the identical read: this is a harness result, not evidence of a smarter model, with one r/accelerate commenter putting it plainly - the models already have more capability than assumed, and the way they're being used has been the actual bottleneck. That reframing matters for anyone tracking AI progress: roughly 70 percentage points of task completion came from scaffolding engineering, not from a model upgrade.

Why 100% Comes With A Structural Asterisk

NVIDIA itself caveats the headline number: this is not a controlled ablation study, the AVO and baseline systems differ in backend, observation format, and memory design, and the 100% figure covers only the 25-environment public set, not ARC-AGI-3's private competition split [4]. Francois Chollet, the benchmark's creator, made the distinction publicly: 'To be clear, like with several other recent claims, scoring 100% on the public demonstration set is not the same as 'scoring 100% on the ARC-AGI-3 benchmark'. It would be like saying you beat a videogame because you cleared the tutorial level.' The asterisk is structural, not incidental: per one widely-cited Reddit breakdown of the result, ARC-AGI-3's rules disallow harnesses like AVO on the private split entirely, meaning NVIDIA's approach cannot be evaluated there by design. Compounding the ambiguity, the 100% score was self-reported by NVIDIA using its own reimplementation of the task interface rather than a run independently administered by the ARC Prize Foundation, so it does not carry the same verification status as an entry on the official leaderboard [3]. Chollet's reply became a widely cited counterpoint to NVIDIA's own framing, echoing the same skepticism that surfaced on Reddit.

Inside AVO: Memory, A Supervisor, And A Four-Step Loop

Strip away the marketing and AVO is four fairly legible components stitched together. An inspect-plan-implement-evaluate loop drives each attempt: look at the current state, propose a plan, execute it, judge the result, repeat. A persistent memory layer retains prior implementations and reasoning across attempts, so the system doesn't relearn the same dead end twice. A supervisor agent watches the trajectory for stagnation and redirects strategy when progress stalls, acting as a check against the looping failures that plague long-running agents. And for ARC-AGI-3 specifically, AVO runs in a text-only modality, reasoning over 64x64 grids as data rather than as rendered images [2]. None of these ideas is individually novel, but wiring them together is what let AVO close 70 percentage points of gap against the exact same base model. It also explains the efficiency figure NVIDIA highlighted: AVO finished the 183 levels in 6,624 total actions, about 12% fewer than the 7,542 actions used by VISTA, a rival Claude-Opus-5-based agent evaluated on the same benchmark [4]. Commentators reading that efficiency gap treated it as evidence the architecture is doing real work, not just brute-forcing more attempts at the same problems.

From Optimizing GPU Kernels To Solving Game Grids

AVO wasn't designed for ARC-AGI-3 at all. Its original job was autonomous GPU-kernel optimization on NVIDIA's own DGX B200 hardware: continuous 7-day sessions exploring more than 500 optimization directions, ultimately producing kernels that outperformed FlashAttention-4 by up to 10.5% and cuDNN by up to 3.5% [4]. NVIDIA then pointed the same inspect-plan-implement-evaluate loop, memory layer, and supervisor at ARC-AGI-3's interactive reasoning tasks, changing little beyond the task interface itself. That portability is arguably the more interesting claim sitting under the 100% headline: the scaffolding generalized from optimizing CUDA kernels to solving abstract visual puzzles with no explicit rules or stated goals, which is a different kind of evidence than a single benchmark score. It's also the detail fueling skepticism elsewhere - the top comment on a related r/LocalLLaMA thread dismissed AVO as 'basically marketing fluff from Nvidia,' pointing to it being a closed-source harness built around NVIDIA's own paper, even if the underlying architecture is genuinely effective.

Historical Context

2026-07
Claude Opus 5, evaluated as a bare model with no agent harness, scored approximately 30.2% on the ARC-AGI-3 public set, establishing the baseline AVO's 100% result is measured against.
2026 (prior to August)
AVO originated as a system for autonomous GPU-kernel optimization on NVIDIA DGX B200 hardware, running 7-day continuous sessions that explored 500+ optimization directions and produced kernels outperforming cuDNN by up to 3.5% and FlashAttention-4 by up to 10.5%, before being repurposed for ARC-AGI-3.
2026-08-21
NVIDIA published its developer blog post announcing the AVO ARC-AGI-3 result, with The New Stack and other outlets covering it the same day.

Power Map

Key Players
Subject

NVIDIA AVO agent harness scores 100% on ARC-AGI-3

NV

NVIDIA

Developer of the AVO agent harness and author of the announcement claiming the 100% ARC-AGI-3 result

AN

Anthropic

Creator of Claude Opus 5, the underlying model AVO wraps; the 30% bare-model baseline reflects directly on Opus 5's standalone performance

AR

ARC Prize Foundation / Francois Chollet

Creator and administrator of ARC-AGI-3 and its official leaderboard; publicly disputed NVIDIA's framing of the 100% result

VI

VISTA

Rival agent system also built on Claude Opus 5 for ARC-AGI-3, used by NVIDIA as its efficiency comparison point

Fact Check

4 cited
  1. [1] NVIDIA AVO Reaches 100% on ARC-AGI-3, Demonstrating a Frontier-Level General-Purpose Architecture for Long-Horizon Autonomous Agents
  2. [2] NVIDIA's AVO Hits 100% on ARC-AGI-3 Where the Bare Model Scores 30%
  3. [3] NVIDIA's Coding Agent AVO Scores 100% on ARC-AGI Benchmark
  4. [4] NVIDIA AVO: 100% on ARC-AGI-3 and What It Means for Long-Horizon Agents

Source Articles

Top 5

THE SIGNAL.

Analysts

Called AVO nice work but publicly rejected the implication that it solved ARC-AGI-3, comparing the public-set score to clearing a videogame's tutorial rather than beating the game itself.

Francois Chollet
Creator of the ARC-AGI benchmark, ARC Prize Foundation

Frames AVO as part of a broader industry shift where the scaffolding around a model - routers, harnesses, memory systems, monitoring - now determines capability more than the base model, and argues it should be treated as a core investment rather than an implementation detail.

Saiyam Pathak
Technical commentator, Substack

Argues the agent harness, not the raw model, determines whether a system completes long-horizon tasks, since scaffolding like memory, tool use, and failure recovery converts latent model capability into finished work.

NVIDIA
Official developer blog framing
The Crowd

Our general-purpose coding agent just scored 100% on the ARC-AGI-3 interactive reasoning benchmark. NVIDIA AVO completed all 183 levels across all 25 public environments, figuring out what to do with no instructions, explicit rules, or stated goals.

@@NVIDIAAI5902

This is very nice work from NVIDIA. Like all high-performing approaches on ARC-AGI-3, it uses deep learning-guided on-the-fly synthesis of symbolic world models, i.e. navigating the world by generating programs to represent what you know. To be clear, like with several other recent claims, scoring 100% on the public demonstration set is not the same as "scoring 100% on the ARC-AGI-3 benchmark". It would be like saying you beat a videogame because you cleared the tutorial level.

@@fchollet828

ARC-AGI-3 is solved. AGI is here. It's not a debate. Inflammatory claims aside, NVIDIA solved the ARC-AGI-3 public benchmark with their agent harness, AVO + Opus 5. Opus 5 + AVO boosted Opus 5's score over the standard ARC-AGI harness from 30% --> 100%! It's what a great harness does: exposes latent capabilities of an LLM. For AVO it's: 1. Persistent memory across context windows 2. An inspect → plan → implement → evaluate loop 3. Execution feedback so the agent learns from mistakes at inference time 4. A supervisor that detects stagnation in failed trajectories and redirects the agent 5. External statefulness of the conversation transcript - tool calls, execution artifacts and the agent trajectory The great thing about frontier harness engineering is that you don't need to work at a frontier lab to contribute. Harness advances don't necessarily need to touch the model weights, but can make all the difference.

@@daniel_mac8355

NVIDIA's coding agent scored 100% on ARC-AGI-3 interactive reasoning benchmark

@u/MagicZhang1100
Broadcast
Reading NVIDIA's AVO Paper: How the Same AI Went From ~30 to 100 on ARC-AGI-3 (Public Set)

Reading NVIDIA's AVO Paper: How the Same AI Went From ~30 to 100 on ARC-AGI-3 (Public Set)

Same AI Model. 30% To 100%. What Actually Changed | AI News Daily

Same AI Model. 30% To 100%. What Actually Changed | AI News Daily

Nvidia says its AVO harness lifts Claude Opus 5 to 100% on ARC-AGI-3

Nvidia says its AVO harness lifts Claude Opus 5 to 100% on ARC-AGI-3

NVIDIA AVO agent harness scores 100% on ARC-AGI-3 — AI News | Agentic Brew