BenchLeader

GPT-6 Sol

Reasoning effort

GPT-6 Sol is an OpenAI proprietary reasoning model, released 22 Sept 2026. Its best configuration (max reasoning effort) ranks #30 of 775 on the BenchLeader Index at 66.6 ±3.9, in the upper half. The ± is the point: 94 other configurations score within that range, so they and this one cannot be told apart on quality alone — price and speed are what separate them. It scores highest in composite (83) and lowest in agents & tools (60). At $4.00 per million tokens blended it is among the most expensive ranked models. Output speed of 118 tokens per second puts it faster than most, with a first answer in 89.9 s. It has been measured at 7 reasoning-effort settings; this summary describes the best-scoring one, and the tabs above switch between them. Last measured 19 Oct 2026.

Blended price
$4.00/M
$2.00 in · $10.00 out
Output speed
118 tok/s
measured by Artificial Analysis
First answer
90 s
first token 2.12 s
Context
1.1M
Full answer
94 s
median, reasoning included
Cost per run
$1.04
one full Intelligence Index run
Released
22 Sept 2026
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index67
  2. Reasoning72
  3. Coding67
  4. Agents & tools60
  5. Maths69
  6. Knowledge70
  7. Human preference65
  8. Multimodal62
  9. Long context67
  10. Composite83

Versions

OpenAI has shipped 3 models under this name. Each is ranked on its own results; a newer version often has fewer results so far, which holds its index nearer the average until more arrive.

ModelReleasedIndexRank
GPT-6.1 Solmax29 Sept 202670.0#7
GPT-6 Solmaxthis page22 Sept 202666.6#30
GPT-5.6 Solmax9 Jul 202668.0#16

Reasoning-effort configurations

The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Not stated” collects results from publishers that did not say which setting they used; for a reasoning model that is usually its thinking mode, but we do not assume it. Pick a setting here or at the top of the page to see its price, speed and category scores.

EffortIndexRankSpeedFirst answerChat reply costCategories
no reasoning52.8#299107 tok/s0.81 s$0.0038Coding 50 · Composite 62 · Knowledge 61 · Long context 57 · Multimodal 53 · Reasoning 40
low59.7#125101 tok/s1.44 s$0.0038Coding 54 · Composite 68 · Knowledge 73 · Long context 65 · Multimodal 63 · Reasoning 54
medium62.6#8363 tok/s2.12 s$0.0038Coding 59 · Composite 74 · Knowledge 74 · Long context 66 · Multimodal 64 · Reasoning 64
high63.8#58109 tok/s16 s$0.0038Coding 61 · Composite 77 · Knowledge 74 · Long context 67 · Multimodal 65 · Reasoning 67
xhigh64.4#53108 tok/s57 s$0.0038Coding 61 · Composite 79 · Knowledge 74 · Long context 66 · Multimodal 66 · Reasoning 70
maxbest66.6#30118 tok/s90 s$0.0038Agents & tools 60 · Coding 67 · Composite 83 · Human preference 65 · Knowledge 70 · Long context 67 · Maths 69 · Multimodal 62 · Reasoning 72
not stated––63 tok/s2.12 s$0.0038Composite 66 · Knowledge 37 · Maths 70

What more thinking costs

Turning the effort up buys index points and multiplies the bill. Here max costs 7.9× low for +6.9 on the index — 2.3 points per doubling of spend. Compare that with other models.

low $0.133max $1.04

How its index has moved

23 Sept 2026 to 19 Oct 2026
596672
  • max
  • xhigh
  • high
  • medium

The index is recomputed from scratch every day, so a line moves when a new benchmark result lands, when a publisher revises a score, or when the models it is normalised against change. Early movement usually means the score is still settling.

Benchmark results

See all LLM benchmarks. One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

Benchmarkno reasoninglowmediumhighxhighmaxnot statedSourceTrend
GPQA Diamond–––––94.3%#9–Epoch AI Benchmarking Hub
Arena Hard Prompts–––––1484#58–Arena (LMArena)
LiveBench 2.0 Reasoningnot in indexeffort not stated––––––88.7%#20LiveBench
LiveBench 1.0 Reasoningnot in index–––––88.7%#22–LiveBench
Humanity's Last Exam (AA)not in index18.4%#22734.9%#12141.0%#8044.1%#5246.3%#4447.9%#35–Artificial Analysis
ARC-AGI-129.3%#19672.2%#13183.7%#10891.0%#6392.7%#4995.5%#31–ARC Prize
ARC-AGI-21.7%#19731.5%#12157.8%#9168.9%#5878.1%#4189.6%#17–ARC Prize
ARC-AGI-31.2%#361.8%#344.9%#275.9%#269.5%#2123.0%#18–ARC Prize
CritPt4.0%#16516.3%#8624.6%#4625.4%#4228.0%#2830.9%#12–Artificial Analysis
MysteryMechanismnot in index–––––30.2%#14–Vals AI
Chess Puzzlesnot in index–––––56.0%#15–Epoch AI Benchmarking Hub
Mystery Game Puzzlesnot in index–––––56.0%#9–Epoch AI Benchmarking Hub
LMCAnot in index–––––59.1%#36–Epoch AI Benchmarking Hub
DTBenchnot in index–––––97.3%#9–Epoch AI Benchmarking Hub

Coding

Benchmarkno reasoninglowmediumhighxhighmaxnot statedSourceTrend
SciCode47.3%#12450.2%#10653.8%#7054.9%#5755.1%#5057.6%#26–SciCode
FrontierCode–––––49.3%#9–Cognition
Arena Coding–––––1518#39–Arena (LMArena)
Arena WebDev–––––1683#9–Arena (LMArena)
LiveBench 2.0 Codingnot in indexeffort not stated––––––93.1%#9LiveBench
LiveBench 1.0 Codingnot in index–––––81.8%#13–LiveBench
SciCode (AA)not in index47.3%#13150.2%#10753.8%#7354.9%#5855.1%#5257.6%#26–Artificial Analysis
IOI–––––82.6%#10–Vals AI
Code Migrationnot in index–––––57.2%#9–Vals AI
ProgramBenchnot in index–––––2.0%#10–Vals AI
Vibe Code Bench v1.1not in index–––––87.8%#10–Vals AI
ALE-Benchnot in index–––––2462#3–Epoch AI Benchmarking Hub
Terminal-Bench 4.0 (AA)not in index13.1%#759.1%#8918.7%#6526.3%#5030.3%#4543.9%#25–Artificial Analysis

Agents & tools

Benchmarkno reasoninglowmediumhighxhighmaxnot statedSourceTrend
Terminal-Bench–––––49.4%#36–Terminal-Bench
APEX-Agents–––––54.3%#23–Mercor
Arena Agent–––––9.3#7–Arena (LMArena)
LiveBench Long Agenticnot in indexeffort not stated––––––66.9%#7LiveBench
LiveBench Browsernot in indexeffort not stated––––––92.0%#3LiveBench
LiveBench Agentic Codingnot in index–––––52.9%#37–LiveBench
Terminal-Bench 2.1 (Vals)–––––83.2%#6–Vals AI
GDPval-AA v2.1not in index37.5%#10935.0%#12042.3%#9044.7%#7647.8%#5950.4%#50–Artificial Analysis
ITBench SRE (AA)not in index–––––49.4%#7–Artificial Analysis
CyberBenchnot in index–––––78.0%#2–Vals AI
Finance Agent v2not in index–––––49.0%#47–Vals AI
Legal Research Benchnot in index–––––28.9%#50–Vals AI
SREBenchnot in index–––––30.5%#6–Vals AI
Tax Agent Benchnot in index–––––15.0%#51–Vals AI
Terminal-Bench 4.0 (Vals)not in index–––––44.4%#10–Vals AI
Terminal-Bench Sciencenot in index–––––30.0%#8–Vals AI
Arena Searchnot in index–––––1228#7–Arena (LMArena)
Vending-Bench 2not in indexeffort not stated––––––14427.9#2Andon Labs
AutomationBenchnot in index34.2%#11053.9%#6358.0%#4460.1%#3461.7%#2961.6%#30–Artificial Analysis
GDP.pdf (AA)not in index17.0%#8624.2%#3523.8%#4024.4%#3424.6%#3125.2%#29–Artificial Analysis
Harvey LAB-AA v1.1not in index–––––3.6%#11–Harvey
AA-Briefcase v1.1not in index–––––1481#33–Artificial Analysis
Terminal-Bench-Science 0.1 (AA)not in index5.7%#353.3%#428.6%#3117.1%#1917.6%#1830.0%#12–Artificial Analysis
CWE-Bench (AA)–––––64.2%#3–Artificial Analysis
DeepSec-Bench (AA)–––––46.3%#1–Artificial Analysis
CyberGym end-to-end (AA)–––––0.0%#16–Artificial Analysis
FACTS Searchnot in indexeffort not stated––––––86.2%#5Google

Knowledge

Benchmarkno reasoninglowmediumhighxhighmaxnot statedSourceTrend
SimpleQA Verified–––––60.7%#15–Epoch AI Benchmarking Hub
LiveBench 2.0 Data Analysisnot in indexeffort not stated––––––81.2%#6LiveBench
LiveBench Researchnot in indexeffort not stated––––––69.3%#31LiveBench
LiveBench 1.0 Data Analysisnot in index–––––81.2%#6–LiveBench
AA-Omniscience-0.8#14226.5#4727.0#4426.8#4526.7#4627.1#43–Artificial Analysis
PRBench Legaleffort not stated––––––38.6%#34Scale AI SEAL
BioMysteryBenchnot in index–––––74.8%#7–Vals AI
Excel Modeling Benchmarknot in index–––––71.5%#11–Vals AI
MedCodenot in index–––––47.1%#36–Vals AI
MedScribenot in index–––––82.0%#50–Vals AI
Public Benefits Benchnot in index–––––56.6%#37–Vals AI
EBR-benchnot in index–––––53.3%#6–Epoch AI Benchmarking Hub
GDP.pdfnot in index–––––26.4%#15–Epoch AI Benchmarking Hub
AA-Omniscience: accuracynot in index45.2%#9051.3%#5853.5%#4753.7%#4553.9%#4454.5%#41–Artificial Analysis
AA-Omniscience: non-hallucinationnot in index16.0%#32949.3%#11843.2%#14741.9%#15141.1%#15439.9%#159–Artificial Analysis

Instruction following

BenchmarkmaxSourceTrend
LiveBench Languagenot in index85.3%#15LiveBench
LiveBench Instruction Followingnot in index68.6%#34LiveBench
Arena Instruction Followingnot in index1452#62Arena (LMArena)

Human preference

BenchmarkmaxSourceTrend
Arena Text1459#61Arena (LMArena)
Arena Creative Writingnot in index1438#60Arena (LMArena)
Arena Multi-turnnot in index1467#66Arena (LMArena)
Arena Longer Queriesnot in index1465#69Arena (LMArena)

Multimodal

Benchmarkno reasoninglowmediumhighxhighmaxnot statedSourceTrend
Arena Vision–––––1240#73–Arena (LMArena)
LiveBench Designnot in indexeffort not stated––––––82.2%#9LiveBench
MMMU-Pro70.3%#14380.2%#5080.4%#4882.0%#3582.5%#3183.0%#28–Artificial Analysis
SAGEnot in index–––––44.8%#44–Vals AI
Blueprint-Bench 2not in indexeffort not stated––––––36.9%#8Epoch AI Benchmarking Hub
AA-3Dnot in index–––––1123#6–Artificial Analysis

Long context

Benchmarkno reasoninglowmediumhighxhighmaxSourceTrend
AA-LCR64.0%#25779.3%#9782.3%#4083.7%#1581.3%#5583.7%#15Artificial Analysis
MLCRnot in index–––––16.1%#41Artificial Analysis

Composite

Benchmarkno reasoninglowmediumhighxhighmaxnot statedSourceTrend
Epoch Capabilities Indexnot in indexeffort not stated––––––163.7#8Epoch AI Benchmarking Hub
LiveBench 2.0effort not stated––––––81.9%#9LiveBench
LiveBench 1.0not in index–––––79.3%#14–LiveBench
AA Intelligence Index v4.3.228.5#13134.1#9739.8#6442.4#4944.2#4147.6#27–Artificial Analysis
AA Cyber Indexnot in index–––––36.8#9–Artificial Analysis

Safety & honesty

Benchmarknot statedSourceTrend
FORTRESSnot in index13.5%#58Scale AI SEAL

Where it wins

Benchmarks where this configuration ranks in the top five of every configuration measured.

Where to run it

Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.

ProviderSpeedFirst tokenInput $/MOutput $/MContextQuantisation
Azure118 tok/s7.77 s$2.20$11.001.1M–
OpenAI89 tok/s1.74 s$4.00$20.001.1M–
Amazon Bedrock65 tok/s3.57 s$2.20$11.001.1M–
OpenAI63 tok/s2.12 s$2.00$10.001.1M–
OpenAI59 tok/s1.21 s$1.00$5.001.1M–
Azure39 tok/s3.17 s$2.00$10.001.1M–

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache at $0.200 per 1M. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.0038$0.00331.5 min
Summarize a 30-page report12,000 / 600$0.030$0.0141.6 min
Code edit6,000 / 1,500$0.027$0.0191.7 min
Agentic coding session60,000 / 4,000$0.160$0.0792.1 min
Structured extraction2,000 / 200$0.0060$0.00331.5 min

More from OpenAI

New this month

Compare GPT-6 Sol with…

See also

Data as of 21 Oct 2026. Compare these configurations.

Cite as: BenchLeader, “GPT-6 Sol: benchmarks, pricing, speed and rank”, https://www.benchleader.com/models/gpt-6-sol, data as of 21 Oct 2026.