VerdictPal
Join

Models / Anthropic

Claude Opus 4.8

Claude Opus · Released 2026-05-28

Anthropic's May 2026 flagship. Tops the Vals Index (70.17%) and the Artificial Analysis Intelligence Index (61.4). SWE-bench Verified 88.6%, Terminal-Bench 2.0 74.6%, 1M-token context, $15 / $75 per 1M tokens.

Front-door model for hard reasoning, long documents, agentic coding, and tool-heavy research. The model we reach for first when a task is too hard for Sonnet but small enough to fit in one prompt.

#4 of 24 on Vals Index · current snapshot
70 Vals Index · 30 benchmark rows · 12 sourcesPosition is benchmark-specific — not a cross-family or cross-source ranking.
Composite67
Context1M
Input / 1M$15
Output / 1M$75
Knowledge cutoff2026-02-01
Statusflagship
ClaudeFactoryPerplexity

Family profile

Best published score in each covered benchmark family.

86/100 avg
Knowledge
91
Reasoning
80
Math
94
Coding
96
Agentic
100
Multimodal
71
Long context
58
Tool use
87
Safety
92
Human preference
92

10 tested benchmark families

Editor's note
Opus 4.8 is the model we reach for first when a task is hard enough to make a Sonnet hallucinate but small enough to fit in one prompt. The 1M context window is real, not marketing — long-document citation fidelity and BFCL scores back it up. The single-number rank (Vals, AA) is the highest we've measured.
Benchmark placements

Where Claude Opus 4.8 places on each public benchmark source that publishes a row. Rank counts every model with a latest row in the same test — not a universal quality score.

BenchmarkFamilyRankScoreSourceDate
LongBench v2Long context#1/ 1958LongBench v2 leaderboard2026-04-01
MMLUKnowledge#1/ 2291Anthropic Claude 4 family2026-05-28
LMArena (Chatbot Arena)Human preference#2/ 1392LMArena leaderboard2026-05-25
GDPvalAgentic#2/ 6100Artificial Analysis — GDPval-AA v22026-06-17
HELM SafetySafety#2/ 992Stanford HELM leaderboard2026-05-28
LiveBenchReasoning#2/ 2171LiveBench leaderboard2026-04-15
MCP AtlasTool use#2/ 1079MCP Atlas leaderboard2026-06-09
SWE-bench VerifiedCoding#2/ 2389SWE-bench official leaderboard2026-05-30
BFCLTool use#3/ 2087Berkeley Function Calling Leaderboard V42026-04-15
HumanEvalCoding#3/ 1596Anthropic Claude 4 family2026-05-28
MMMUMultimodal#3/ 871MMMU leaderboard2026-05-28
Terminal-Bench-ScienceAgentic#4/ 911Terminal-Bench-Science 0.1 announcement2026-08-27
Vals IndexAgentic#4/ 2370Vals AI — Vals Index2026-06-04
DeepSWECoding#5/ 859DeepSWE leaderboard v1.12026-06-20
FrontierMathMath#5/ 1547Epoch AI FrontierMath Tiers 1-3 (v2) CSV2026-08-15
Humanity's Last ExamReasoning#7/ 18049Artificial Analysis2026-09-01
AA-OmniscienceKnowledge#9/ 1249Artificial Analysis — AA-Omniscience2026-09-01
AIMEMath#10/ 3794Anthropic Claude 4 family2026-05-28
Artificial Analysis Intelligence IndexReasoning#10/ 18757Artificial Analysis2026-09-01
CritPtReasoning#10/ 1221Artificial Analysis — CritPt2026-09-01
MATHMath#11/ 2588Anthropic Claude 4 family2026-05-28
SciCodeCoding#22/ 18054Artificial Analysis2026-09-01
MMLU-ProKnowledge#27/ 3982MMLU-Pro HuggingFace leaderboard2026-05-28
τ³-Bench BankingAgentic#31/ 10634Artificial Analysis2026-09-01
Terminal-BenchAgentic#36/ 18475Terminal-Bench 2.0 leaderboard2026-05-20
IFBenchReasoning#78/ 12762Artificial Analysis2026-09-01
AA time to first tokenPerformance#98/ 186Artificial Analysis2026-09-01
AA output speedPerformance#99/ 187Artificial Analysis2026-09-01
GPQA DiamondReasoning#139/ 18580GPQA Diamond paper leaderboard2026-05-15
AA-LCRLong context#142/ 17958Artificial Analysis — AA-LCR2026-06-17
Family context

The three highest-scoring models with pages in each capability family. Where Claude Opus 4.8 shows up, it's highlighted.

KnowledgeClaude Opus 4.8 · 91
  1. 1
    GPT 5.5
    91
  2. 2
    Claude Opus 4.8
    91
  3. 3
    Claude Sonnet 4.6
    91
ReasoningClaude Opus 4.8 · 80
  1. 1
    Claude Mythos Preview
    95
  2. 2
    Gemini 3.7 Flash
    95
  3. 3
    Grok 4.6
    95
MathClaude Opus 4.8 · 94
  1. 1
    OpenAI o3
    99
  2. 2
    GPT-5 (medium)
    99
  3. 3
    GPT-5 (high)
    99
CodingClaude Opus 4.8 · 96
  1. 1
    GPT 5.5
    96
  2. 2
    Claude Opus 4.8
    96
  3. 3
    Claude Opus 4.6
    96
AgenticClaude Opus 4.8 · 100
  1. 1
    GPT 5.5
    100
  2. 2
    Claude Opus 4.8
    100
  3. 3
    Claude Fable 5
    100
Long contextClaude Opus 4.8 · 58
  1. 1
    Muse Spark 1.2
    83
  2. 2
    Kimi K3
    83
  3. 3
    Gemini 3.5 Flash
    81
Tool useClaude Opus 4.8 · 87
  1. 1
    Claude Sonnet 4.6
    89
  2. 2
    GPT 5.5
    87
  3. 3
    Claude Opus 4.8
    87
SafetyClaude Opus 4.8 · 92
  1. 1
    Claude Opus 4 (2024-07)
    92
  2. 2
    Claude Opus 4.8
    92
  3. 3
    GPT 5.5
    91
Human preferenceClaude Opus 4.8 · 92
  1. 1
    GPT 5.5
    95
  2. 2
    Claude Opus 4.8
    92
  3. 3
    Gemini 3.5 Flash
    91
Newest receipts

Benchmark rows added to the public ledger for Claude Opus 4.8 in the last 120 days. Older rows live in the full table below.

27 recent
BenchmarkFamilyScoreSourceDays ago
CritPtReasoning20.9%Artificial Analysis — CritPt5
AA-OmniscienceKnowledge48.8%Artificial Analysis — AA-Omniscience5
AA output speedPerformance0 t/sArtificial Analysis5
AA time to first tokenPerformance0.00sArtificial Analysis5
Artificial Analysis Intelligence IndexReasoning57.3%Artificial Analysis5
Humanity's Last ExamReasoning48.7%Artificial Analysis5
IFBenchReasoning62.24%Artificial Analysis5
SciCodeCoding53.5%Artificial Analysis5
τ³-Bench BankingAgentic34.23%Artificial Analysis5
Terminal-Bench-ScienceAgentic10.5%Terminal-Bench-Science 0.1 announcement10
FrontierMathMath47.24%Epoch AI FrontierMath Tiers 1-3 (v2) CSV22
DeepSWECoding59%DeepSWE leaderboard v1.178
GDPvalAgentic1638Artificial Analysis — GDPval-AA v281
AA-LCRLong context58.3%Artificial Analysis — AA-LCR81
MCP AtlasTool use79.2%MCP Atlas leaderboard89
Vals IndexAgentic70.4%Vals AI — Vals Index94
SWE-bench VerifiedCoding88.6%SWE-bench official leaderboard99
AIMEMath94.2%Anthropic Claude 4 family101
HELM SafetySafety91.8%Stanford HELM leaderboard101
HumanEvalCoding95.8% pass@1Anthropic Claude 4 family101
MATHMath88.4%Anthropic Claude 4 family101
MMLU-ProKnowledge82.4%MMLU-Pro HuggingFace leaderboard101
MMLUKnowledge91.4%Anthropic Claude 4 family101
MMMUMultimodal70.6%MMMU leaderboard101
LMArena (Chatbot Arena)Human preference1462LMArena leaderboard104
Terminal-BenchAgentic74.6%Terminal-Bench 2.0 leaderboard109
GPQA DiamondReasoning79.8%GPQA Diamond paper leaderboard114
Family coverage

A high composite that hides a weak family is a trap. These bars surface the families where this model hasn't been publicly tested, and where it leads.

Knowledge91
Reasoning80
Math94
Coding96
Agentic100
Multimodal71
Long context58
Tool use87
Safety92
Human preference92
Price vs. performance
0255075100$0.10$0.30$1$3$10$30input USD / 1M tokens · log scale →← intelligence

Hover any dot for name, score, and input price. Keyboard: tab through the top twelve, or use the ranking below.

AnthropicOpenAIMistralAlibabaDeepSeekGoogleMoonshotMetaMiniMaxxAIZhipuXiaomiOtherMeituanCohereNVIDIA

Full benchmark ledger

Every catalog benchmark for Claude Opus 4.8. Scores link to the original source; gaps mean no public row exists yet.

30 sourced rows

30 of 37 catalog benchmarks have a sourced row for Claude Opus 4.8.

Knowledge

Reasoning

Math

Coding

Agentic

Multimodal

Long context

Tool use

Performance

Safety

Human preference

Changelog
  1. Released Claude Opus 4.8 — top of Vals (70.17%) and AA (61.4).
  2. Claude Opus 4.7 retired for general availability.
Sources