BenchLeader

Claude Opus 4.8

Reasoning effort

Claude Opus 4.8 is an Anthropic proprietary reasoning model, released 28 May 2026. Its best configuration (max reasoning effort) ranks #64 of 775 on the BenchLeader Index at 63.4 ±4.8, in the upper half. The ± is the point: 160 other configurations score within that range, so they and this one cannot be told apart on quality alone — price and speed are what separate them. It scores highest in composite (76) and lowest in agents & tools (57). At $10.00 per million tokens blended it is among the most expensive ranked models. Output speed of 63 tokens per second puts it slower than most, with a first answer in 44.6 s. It has been measured at 8 reasoning-effort settings; this summary describes the best-scoring one, and the tabs above switch between them. Last measured 1 Jun 2026.

Blended price
$10.00/M
$5.00 in · $25.00 out
Output speed
63 tok/s
measured by Artificial Analysis
First answer
45 s
first token 0.97 s
Context
1M
Full answer
53 s
median, reasoning included
Cost per run
$4.08
one full Intelligence Index run
Released
28 May 2026
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index63
  2. Reasoning69
  3. Coding59
  4. Agents & tools57
  5. Maths68
  6. Knowledge67
  7. Instruction following62
  8. Long context64
  9. Composite76

Versions

Anthropic has shipped 9 models under this name. Each is ranked on its own results; a newer version often has fewer results so far, which holds its index nearer the average until more arrive.

ModelReleasedIndexRank
Claude Opus 5.5max22 Sept 202672.7#1
Claude Opus 5max24 Jul 202668.9#15
Claude Opus 4.8maxthis page28 May 202663.4#64
Claude Opus 4.716 Apr 202663.4#63
Claude Opus 4.6high5 Feb 202662.9#76
Claude Opus 4.5thinking24 Nov 202560.0#119
Claude Opus 4.1thinking5 Aug 202556.5#199
Claude Opus 4thinking22 May 202555.1#230
Claude 3 Opus4 Mar 202439.2#681

Reasoning-effort configurations

The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Not stated” collects results from publishers that did not say which setting they used; for a reasoning model that is usually its thinking mode, but we do not assume it. Pick a setting here or at the top of the page to see its price, speed and category scores.

EffortIndexRankSpeedFirst answerChat reply costCategories
no reasoning––66 tok/s0.97 s$0.0095Coding 64 · Maths 60 · Reasoning 62
low––66 tok/s0.97 s$0.0095Maths 66 · Reasoning 62
medium––66 tok/s0.97 s$0.0095Coding 68 · Reasoning 64
high60.9#10466 tok/s0.97 s$0.0095Coding 62 · Human preference 68 · Maths 68 · Multimodal 64 · Reasoning 61
xhigh––66 tok/s0.97 s$0.0095Coding 72 · Reasoning 30
maxbest63.4#6463 tok/s45 s$0.0095Agents & tools 57 · Coding 59 · Composite 76 · Instruction following 62 · Knowledge 67 · Long context 64 · Maths 68 · Reasoning 69
thinking––66 tok/s0.97 s$0.0095Reasoning 80
not stated60.1#11766 tok/s0.97 s$0.0095Agents & tools 52 · Coding 62 · Composite 60 · Human preference 65 · Knowledge 62 · Maths 66 · Multimodal 63 · Reasoning 64

How its index has moved

8 Sept 2026 to 21 Oct 2026
556270
  • max
  • high
  • not stated

The index is recomputed from scratch every day, so a line moves when a new benchmark result lands, when a publisher revises a score, or when the models it is normalised against change. Early movement usually means the score is still settling.

Benchmark results

See all LLM benchmarks. One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

Benchmarkno reasoninglowmediumhighxhighmaxthinkingnot statedSourceTrend
GPQA Diamond85.3%#8788.4%#59–––91.0%#32––Epoch AI Benchmarking Hub
SimpleBencheffort not stated–––––––64.8%#17SimpleBench
Arena Hard Prompts–––1513#15–––1505#23Arena (LMArena)
LiveBench 2.0 Reasoningnot in indexeffort not stated–––––––89.2%#18LiveBench
LiveBench 1.0 Reasoningnot in index–––––89.2%#19––LiveBench
GPQA Diamond (AA)not in index–––––92.0%#41––Artificial Analysis
Humanity's Last Exam (AA)not in index–––––48.7%#32––Artificial Analysis
GPQA Diamond (Vals)not in indexeffort not stated–––––––92.4%#16Vals AI
EnigmaEval––––23.5%#5–––Scale AI SEAL
Kagi LLM Benchmark––––––88.8%#2–Kagi LLM Benchmark
ARC-AGI-1–88.0%#8391.5%#6092.0%#56–92.5%#51––ARC Prize
ARC-AGI-2–62.2%#7371.7%#5472.1%#52––––ARC Prize
ARC-AGI-3–––1.5%#35––––ARC Prize
CritPt–––––20.9%#56––Artificial Analysis
Chess Puzzlesnot in index19.0%#9429.0%#68–––52.0%#17––Epoch AI Benchmarking Hub
Mystery Game Puzzlesnot in index––––31.0%#3236.0%#21––Epoch AI Benchmarking Hub
LMCAnot in index–––––57.5%#39––Epoch AI Benchmarking Hub
DTBenchnot in index–––––94.9%#46––Epoch AI Benchmarking Hub
ForecastBenchnot in index–––––66.3%#4–62.6%#53ForecastBench
BTF-3not in index–––14.0%#613.2%#11–––Epoch AI Benchmarking Hub

Coding

Benchmarkno reasoninglowmediumhighxhighmaxnot statedSourceTrend
SciCode–––––53.5%#75–SciCode
WeirdML70.5%#32–76.0%#27–82.9%#17––WeirdML
FrontierCodeeffort not stated––––––46.5%#14Cognition
GSO-Bencheffort not stated––––––47.1%#5GSO-Bench
Arena Coding–––1534#17––1529#23Arena (LMArena)
Arena WebDev–––1556#38––1536#47Arena (LMArena)
LiveBench 2.0 Codingnot in indexeffort not stated––––––77.3%#33LiveBench
LiveBench 1.0 Codingnot in index–––––81.8%#12–LiveBench
SciCode (AA)not in index–––––54.4%#62–Artificial Analysis
LiveCodeBencheffort not stated––––––87.8%#11Vals AI
SWE-bench (Vals)not in indexeffort not stated––––––88.6%#12Vals AI
Code Migrationnot in indexeffort not stated––––––47.3%#15Vals AI
ProgramBenchnot in indexeffort not stated––––––1.0%#15Vals AI
Vibe Code Bench v1.1not in indexeffort not stated––––––82.7%#21Vals AI
SWE Atlas: Codebase QnAnot in index––––57.3%#4––Scale AI SEAL
SWE Atlas: Refactoringnot in indexeffort not stated––––––46.7%#5Scale AI SEAL
SWE Atlas: Test Writingnot in index––––49.6%#6––Scale AI SEAL
Surface Evolver Benchnot in index68.1%#11––87.5%#6–––Epoch AI Benchmarking Hub
DeepSWE v1.1not in index–40.8%#5648.7%#4951.8%#4654.4%#3959.0%#34–Epoch AI Benchmarking Hub
ALE-Benchnot in index1411.8#26––1563.8#21–––Epoch AI Benchmarking Hub
Terminal-Bench 4.0 (AA)not in index–––––21.7%#58–Artificial Analysis
Terminal-Bench 2.1 (AA)not in index–––––84.6%#28–Artificial Analysis

Agents & tools

Benchmarklowmediumhighmaxnot statedSourceTrend
Terminal-Bench–––23.6%#68–Terminal-Bench
OSWorld-Verified 2.0–––20.6%#7–OSWorld
Remote Labor Indexeffort not stated––––8.3%#5Scale AI / CAIS
APEX-Agents–––48.9%#29–Mercor
LiveBench Long Agenticnot in indexeffort not stated––––48.3%#16LiveBench
LiveBench Browsernot in indexeffort not stated––––96.0%#2LiveBench
LiveBench Agentic Codingnot in index–––50.5%#43–LiveBench
Terminal-Bench Hard–––58.3%#10–Artificial Analysis
τ²-Bench Telecom (AA)not in index–––94.4%#30–Artificial Analysis
Terminal-Bench 2.1 (Vals)effort not stated––––71.9%#25Vals AI
MCP Atlas–––82.2%#9–Scale AI SEAL
HiL-Bencheffort not stated––––35.3%#21Scale AI SEAL
τ³-bench Bankingnot in index–––39.7%#8–τ²-bench
GDPval-AA v2.1not in index–––47.7%#60–Artificial Analysis
τ³-Banking (AA)–––34.2%#54–Artificial Analysis
Analyst Agent (AA)not in index–––45.0%#17–Artificial Analysis
Finance Agent v2not in indexeffort not stated––––53.9%#28Vals AI
Legal Research Benchnot in indexeffort not stated––––43.8%#20Vals AI
SkillsBenchnot in indexeffort not stated––––59.2%#9Vals AI
Tax Agent Benchnot in indexeffort not stated––––30.0%#28Vals AI
Terminal-Bench 2.0 (Vals)not in indexeffort not stated––––70.0%#2Vals AI
Terminal-Bench 4.0 (Vals)not in indexeffort not stated––––23.2%#25Vals AI
Terminal-Bench Sciencenot in indexeffort not stated––––4.3%#25Vals AI
Time Horizon Index: KSPnot in indexeffort not stated––––11.8%#8Vals AI
Arena Searchnot in indexeffort not stated––––1195#22Arena (LMArena)
DeepResearch Benchnot in index49.3%#1447.4%#2450.2%#10––DeepResearch Bench
PostTrainBenchnot in index––33.8%#432.9%#5–Epoch AI Benchmarking Hub
GBAEvalnot in indexeffort not stated––––70.9%#3Epoch AI Benchmarking Hub
Vending-Bench 2not in index–––2992.3#495787.4#23Andon Labs
AutomationBenchnot in index–––45.6%#89–Artificial Analysis
GDP.pdf (AA)not in index–––22.8%#44–Artificial Analysis
EnterpriseOps-Gymnot in index–––44.0%#18–Artificial Analysis
FACTS Searchnot in indexeffort not stated––––79.6%#13Google

Maths

Benchmarkno reasoninglowhighmaxnot statedSourceTrend
FrontierMath Tiers 1–3–––80.0%#17–Epoch AI Benchmarking Hub
FrontierMath Tier 4–––56.1%#24–Epoch AI Benchmarking Hub
OTIS Mock AIME84.4%#9797.8%#30–98.3%#23–Epoch AI Benchmarking Hub
ProofBench–––69.0%#17–Vals AI
LiveBench Mathematicsnot in index–––94.3%#19–LiveBench
AIME 2026possible contamination–––100.0%#1–MathArena
HMMT February 2026possible contamination–––95.5%#6–MathArena
MathArena Apexpossible contamination–––81.3%#1–MathArena
Arena Maths––1494#25–1476#43Arena (LMArena)

Knowledge

Benchmarkmaxnot statedSourceTrend
SimpleQA Verified53.0%#22–Epoch AI Benchmarking Hub
LiveBench 2.0 Data Analysisnot in indexeffort not stated–66.0%#38LiveBench
LiveBench Researchnot in indexeffort not stated–81.8%#16LiveBench
LiveBench 1.0 Data Analysisnot in index66.0%#56–LiveBench
AA-Omniscience28.8#36–Artificial Analysis
MMLU-Proeffort not stated–89.6%#9Vals AI
LegalBencheffort not stated–83.6%#52Vals AI
CorpFineffort not stated–66.7%#17Vals AI
TaxEvaleffort not stated–75.6%#14Vals AI
Excel Modeling Benchmarknot in indexeffort not stated–69.4%#14Vals AI
MedCodenot in indexeffort not stated–53.2%#10Vals AI
MedScribenot in indexeffort not stated–85.8%#26Vals AI
Public Benefits Benchnot in indexeffort not stated–68.1%#12Vals AI
DrugDiscoveryBenchnot in index46.8%#8–Scale AI SEAL
EBR-benchnot in index28.6%#14–Epoch AI Benchmarking Hub
GDP.pdfnot in index24.0%#19–Epoch AI Benchmarking Hub
AA-Omniscience: accuracynot in index48.8%#68–Artificial Analysis
AA-Omniscience: non-hallucinationnot in index60.8%#73–Artificial Analysis

Instruction following

Benchmarkhighmaxnot statedSourceTrend
LiveBench Languagenot in index–79.7%#35–LiveBench
LiveBench Instruction Followingnot in index–72.0%#20–LiveBench
IFBench–62.2%#117–Artificial Analysis
Arena Instruction Followingnot in index1491#12–1478#22Arena (LMArena)

Human preference

Benchmarkhighnot statedSourceTrend
Arena Text1482#251474#39Arena (LMArena)
EQ-Bench 4effort not stated–1281#6EQ-Bench
Arena Creative Writingnot in index1469#181463#26Arena (LMArena)
Arena Multi-turnnot in index1497#121495#17Arena (LMArena)
Arena Longer Queriesnot in index1503#101499#16Arena (LMArena)

Multimodal

Benchmarkhighnot statedSourceTrend
Arena Vision1295#231289#28Arena (LMArena)
LiveBench Designnot in indexeffort not stated–78.8%#16LiveBench
MMMU-Pro (Vals)not in indexeffort not stated–86.6%#18Vals AI
MortgageTaxnot in indexeffort not stated–69.9%#5Vals AI
SAGEnot in indexeffort not stated–54.8%#3Vals AI
Blueprint-Bench 2not in indexeffort not stated–14.5%#26Epoch AI Benchmarking Hub

Long context

Benchmarkhighmaxnot statedSourceTrend
AA-LCR–77.7%#127–Artificial Analysis
Arena Documentnot in index1486#9–1475#16Arena (LMArena)
MLCRnot in index–45.6%#14–Artificial Analysis

Composite

Benchmarkmaxnot statedSourceTrend
Epoch Capabilities Indexnot in indexeffort not stated–159.0#17Epoch AI Benchmarking Hub
LiveBench 2.0effort not stated–76.8%#13LiveBench
LiveBench 1.0not in index76.2%#30–LiveBench
AA Intelligence Index v4.3.241.8#56–Artificial Analysis
Vals Multimodal Indexnot in indexeffort not stated–70.9%#5Vals AI

Safety & honesty

BenchmarkmaxSourceTrend
FORTRESSnot in index18.2%#42Scale AI SEAL

Where it wins

Benchmarks where this configuration ranks in the top five of every configuration measured.

Where to run it

Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.

ProviderSpeedFirst tokenInput $/MOutput $/MContextQuantisation
Anthropic159 tok/s0.58 s$10.00$50.001M–
Google Vertex78 tok/s2.23 s$5.00$25.001M–
Amazon Bedrock75 tok/s2.51 s$5.00$25.001M–
Anthropic73 tok/s2.90 s$5.00$25.001M–
Amazon Bedrock66 tok/s3.17 s$5.50$27.501M–
Claude Platform on AWS65 tok/s1.02 s$5.00$25.001M–
Azure41 tok/s1.12 s$5.00$25.001M–

Price history

Listed price per 1M tokens over time, as recorded by OpenRouter for the provider with the longest history.

$0.00$7.56$15.13$22.69$30.25May 26Jun 26Jul 26Aug 26Sept 26
input outputnow $5.50 in · $27.50 out

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache at $0.500 per 1M. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.0095$0.008149.3 s
Summarize a 30-page report12,000 / 600$0.075$0.03554.1 s
Code edit6,000 / 1,500$0.068$0.0471.1 min
Agentic coding session60,000 / 4,000$0.400$0.1981.8 min
Structured extraction2,000 / 200$0.015$0.008347.7 s

More from Anthropic

New this month

Compare Claude Opus 4.8 with…

See also

Data as of 21 Oct 2026. Compare these configurations.

Cite as: BenchLeader, “Claude Opus 4.8: benchmarks, pricing, speed and rank”, https://www.benchleader.com/models/claude-opus-4-8, data as of 21 Oct 2026.