Valumigo

Epoch AI · Reasoning through unfamiliar puzzles (ARC-AGI-2)

We regularly fetch and display public benchmark data: LMArena user-voted rankings and Epoch AI test scores. Each leaderboard shows its publication and retrieval dates. These scores are not produced by this site.

LMArena scores come from people comparing two models' answers side by side and voting for the better one, using an Elo-based system. If score differences fall within the confidence intervals, treat the models as roughly comparable.

How to read this leaderboard

What it measures: ARC-AGI-2 was created by the ARC Prize Foundation. It requires inferring transformation rules from examples of input and output color grids and applying them to new inputs. The tasks are designed to be solvable by humans while remaining difficult for AI.

How to read the score: The percentage (%) of correctly predicted output grids. Evaluation uses pass@2, allowing two answer submissions per test input.

Caveats: Scores can vary with inference compute and solution methods. Check the evaluation set, attempt conditions and cost per task together.

Insights from this ranking

  • The highest score is 95.0%, achieved by GPT-6 Astra.
  • The gap between 1st and 5th place is 5.0%p.
  • OpenAI has the most models among the top 10, with 4.
  • Results for this test are public for 30 models.

Reasoning through unfamiliar puzzles (ARC-AGI-2) Epoch AI

This data combines scores measured by Epoch AI and published by model developers or evaluation organizations. Each test covers different models, so some may not include the latest releases yet. For models evaluated at multiple reasoning levels, we show the highest score. · Retrieved 2026-10-04

OGPT-6 Astra
95.0%
OGPT-5.6 Sol
92.5%
AnthropicClaude Opus 5.5
92.5%
AnthropicClaude Opus 5
90.4%
AnthropicClaude Fable 5.1
90.0%
OGPT-6 Sol
89.6%
AnthropicClaude Fable 5
89.2%
OGPT-5.5
85.0%
GoogleGemini 3.7 Flash
84.6%
GoogleGemini 3 Deep Think
84.6%
OGPT-5.5 Pro
84.6%
OGPT-5.6 Terra
83.9%
OGPT-5.4 Pro
83.3%
GoogleGemini 3.1 Pro Preview
77.1%
AnthropicClaude Opus 4.7
75.8%
OGPT-5.4
74.0%
GoogleGemini 3.5 Flash
72.1%
AnthropicClaude Opus 4.8
72.1%
AnthropicClaude Opus 4.6
69.2%
xGrok 4.6
67.1%

Bars show accuracy (%) and start at 0%.

View table (top 30)
RankModelDeveloperRelease dateScore
1OGPT-6 Astra(max)OpenAI2026-09-0395.0%
2OGPT-5.6 Sol(max)OpenAI2026-07-0992.5%
3AnthropicClaude Opus 5.5(xhigh)Anthropic2026-09-2292.5%
4AnthropicClaude Opus 5(max)Anthropic2026-07-2490.4%
5AnthropicClaude Fable 5.1(max)Anthropic2026-09-0190.0%
6OGPT-6 Sol(max)OpenAI2026-09-2289.6%
7AnthropicClaude Fable 5(max)Anthropic2026-06-0989.2%
8OGPT-5.5(xhigh)OpenAI2026-04-2385.0%
9GoogleGemini 3.7 Flash(high)Google2026-08-1384.6%
10GoogleGemini 3 Deep ThinkGoogle2026-02-1284.6%
11OGPT-5.5 Pro(high)OpenAI2026-04-2384.6%
12OGPT-5.6 Terra(max)OpenAI2026-07-0983.9%
13OGPT-5.4 Pro(xhigh)OpenAI2026-03-0583.3%
14GoogleGemini 3.1 Pro PreviewGoogle2026-02-1977.1%
15AnthropicClaude Opus 4.7(max)Anthropic2026-04-1675.8%
16OGPT-5.4(xhigh)OpenAI2026-03-0574.0%
17GoogleGemini 3.5 FlashGoogle2026-05-1972.1%
18AnthropicClaude Opus 4.8Anthropic2026-05-2872.1%
19AnthropicClaude Opus 4.6(120k thinking)Anthropic2026-02-0569.2%
20xGrok 4.6(xhigh)xAI2026-08-1267.1%
21xgrok-4-20xAI2026-02-1765.1%
22DeepSeekDeepSeek V4 Flash 0731(max)DeepSeek2026-07-3161.4%
23DeepSeekDeepSeek V4 Pro 0813(max)DeepSeek2026-08-1361.3%
24AnthropicClaude Sonnet 4.6(high)Anthropic2026-02-1760.4%
25Moonshot AIKimi K3(max)Moonshot AI2026-07-1660.4%
26GoogleGemini 3.6 FlashGoogle2026-07-2160.4%
27OGPT-5.6 Luna(max)OpenAI2026-07-0959.5%
28OGPT-6 Luna(max)OpenAI2026-09-2259.3%
29OGPT-5.2 ProOpenAI2025-12-1154.2%
30OGPT-5.2(xhigh)OpenAI2025-12-1152.9%

Data: LMArena leaderboard dataset (CC BY 4.0). Changes: Top 50 entries per leaderboard; scores are rounded. https://huggingface.co/datasets/lmarena-ai/leaderboard-datasetCompany logos are trademarks of their respective owners and are used only for identification (icons: Simple Icons).Data: Epoch AI — Capabilities & benchmarking (CC BY 4.0). https://epoch.ai/benchmarks