BenchLeader

Muse Spark 1.1

Reasoning effort

Muse Spark 1.1 is a Meta proprietary reasoning model, released 9 Jul 2026. Its best configuration ranks #75 of 775 on the BenchLeader Index at 62.9 ±5.7, in the upper half. The ± is the point: 186 other configurations score within that range, so they and this one cannot be told apart on quality alone — price and speed are what separate them. It scores highest in instruction following (74) and lowest in agents & tools (51). At $2.00 per million tokens blended it is pricier than most ranked models. Output speed of 236 tokens per second puts it in the fastest quarter, with a first token in 1.7 s. It has been measured at 4 reasoning-effort settings; this summary describes the best-scoring one, and the tabs above switch between them. Last measured 19 Oct 2026.

Blended price
$2.00/M
$1.25 in · $4.25 out
Output speed
236 tok/s
OpenRouter traffic, 7-day median; not yet measured by Artificial Analysis
First answer
1.68 s
Context
1.0M
Full answer
–
Cost per run
–
Released
9 Jul 2026
How it scores by categoryDashed line = average model (50). One step of 15 = one standard deviation.
  1. Overall index63
  2. Reasoning68
  3. Coding66
  4. Agents & tools51
  5. Maths62
  6. Knowledge69
  7. Instruction following74
  8. Human preference66
  9. Multimodal64

Versions

Meta has shipped 4 models under this name. Each is ranked on its own results; a newer version often has fewer results so far, which holds its index nearer the average until more arrive.

ModelReleasedIndexRank
Muse Spark 1.3max2 Sept 202667.2#26
Muse Spark 1.2xhigh5 Aug 202663.2#69
Muse Spark 1.1this page9 Jul 202662.9#75
Muse Spark8 Apr 202664.4#50

Reasoning-effort configurations

The same model behaves differently depending on how much it is allowed to think. Each row is one setting, scored only on the benchmarks that were run at that setting. “Not stated” collects results from publishers that did not say which setting they used; for a reasoning model that is usually its thinking mode, but we do not assume it. Pick a setting here or at the top of the page to see its price, speed and category scores.

EffortIndexRankSpeedFirst answerChat reply costCategories
medium––236 tok/s1.68 s$0.0018
high––236 tok/s1.68 s$0.0018
xhigh61.6#95280 tok/s21 s$0.0018Agents & tools 59 · Coding 64 · Composite 67 · Knowledge 67 · Long context 64 · Reasoning 66
not statedbest62.9#75236 tok/s1.68 s$0.0018Agents & tools 51 · Coding 66 · Human preference 66 · Instruction following 74 · Knowledge 69 · Maths 62 · Multimodal 64 · Reasoning 68

How its index has moved

8 Sept 2026 to 20 Oct 2026
516171
  • not stated
  • xhigh

The index is recomputed from scratch every day, so a line moves when a new benchmark result lands, when a publisher revises a score, or when the models it is normalised against change. Early movement usually means the score is still settling.

Benchmark results

See all LLM benchmarks. One column per reasoning effort. Rank is among every configuration of every model on that benchmark. Hover a score for the run it came from.

Reasoning

Benchmarkhighxhighnot statedSourceTrend
Arena Hard Promptseffort not stated––1511#18Arena (LMArena)
LiveBench 1.0 Reasoningnot in index–87.7%#26–LiveBench
GPQA Diamond (AA)not in index–89.8%#68–Artificial Analysis
Humanity's Last Exam (AA)not in index–46.2%#45–Artificial Analysis
GPQA Diamond (Vals)not in index–91.2%#23–Vals AI
CritPt–15.1%#92–Artificial Analysis
Chess Puzzlesnot in index–34.0%#57–Epoch AI Benchmarking Hub
LMCAnot in index49.9%#65––Epoch AI Benchmarking Hub
DTBenchnot in index94.4%#56––Epoch AI Benchmarking Hub

Coding

Benchmarkhighxhighnot statedSourceTrend
SciCode–58.8%#1758.8%#17SciCode
Arena Codingeffort not stated––1533#19Arena (LMArena)
Arena WebDeveffort not stated––1542#43Arena (LMArena)
LiveBench 1.0 Codingnot in index–77.2%#39–LiveBench
SciCode (AA)not in index–58.8%#18–Artificial Analysis
LiveCodeBench–85.9%#27–Vals AI
SWE-bench (Vals)not in index–82.0%#21–Vals AI
SWE-Bench Proeffort not stated––61.5%#1Scale AI SEAL
Code Migrationnot in index–31.1%#39–Vals AI
ProgramBenchnot in index–0.0%#32–Vals AI
Vibe Code Bench v1.1not in index–72.2%#38–Vals AI
SWE-Bench Pro (private)not in indexeffort not stated––61.5%#1Scale AI SEAL
SWE Atlas: Codebase QnAnot in index–42.2%#9–Scale AI SEAL
SWE Atlas: Test Writingnot in index–41.5%#10–Scale AI SEAL
Surface Evolver Benchnot in index52.5%#17––Epoch AI Benchmarking Hub
DeepSWE v1.1not in indexeffort not stated––53.3%#45Epoch AI Benchmarking Hub
Terminal-Bench 4.0 (AA)not in index–6.1%#97–Artificial Analysis
Terminal-Bench 2.1 (AA)not in index–77.9%#54–Artificial Analysis

Agents & tools

Benchmarkxhighnot statedSourceTrend
APEX-Agentseffort not stated–31.8%#48Mercor
Arena Agenteffort not stated–-6.6#42Arena (LMArena)
LiveBench Agentic Codingnot in index58.5%#18–LiveBench
Terminal-Bench 2.1 (Vals)69.3%#30–Vals AI
MCP Atlaseffort not stated–88.1%#1Scale AI SEAL
τ³-bench Bankingnot in index40.5%#6–τ²-bench
GDPval-AA v2.1not in index35.6%#117–Artificial Analysis
τ³-Banking (AA)31.8%#62–Artificial Analysis
Finance Agent v2not in index57.2%#16–Vals AI
Legal Research Benchnot in index38.0%#37–Vals AI
SkillsBenchnot in index59.2%#10–Vals AI
Time Horizon Index: KSPnot in index1.7%#13–Vals AI
GBAEvalnot in indexeffort not stated–7.9%#13Epoch AI Benchmarking Hub
Vending-Bench 2not in indexeffort not stated–6520.5#18Andon Labs
AutomationBenchnot in index38.9%#99–Artificial Analysis
GDP.pdf (AA)not in index14.4%#100–Artificial Analysis

Maths

Benchmarkxhighnot statedSourceTrend
ProofBencheffort not stated–39.0%#38Vals AI
LiveBench Mathematicsnot in index87.1%#47–LiveBench
Arena Mathseffort not stated–1496#20Arena (LMArena)

Knowledge

Benchmarkmediumxhighnot statedSourceTrend
SimpleQA Verifiedeffort not stated––57.8%#18Epoch AI Benchmarking Hub
LiveBench 1.0 Data Analysisnot in index–72.5%#45–LiveBench
AA-Omniscience–28.1#39–Artificial Analysis
MMLU-Pro–88.7%#17–Vals AI
LegalBench–85.0%#27–Vals AI
CorpFin–71.3%#4–Vals AI
TaxEval–79.7%#2–Vals AI
PRBench Financeeffort not stated––55.0%#3Scale AI SEAL
PRBench Legaleffort not stated––57.0%#4Scale AI SEAL
MultiNRCeffort not stated––65.6%#1Scale AI SEAL
Excel Modeling Benchmarknot in index–56.4%#44–Vals AI
MedScribenot in index–88.9%#10–Vals AI
Public Benefits Benchnot in index–61.3%#29–Vals AI
GDP.pdfnot in index15.0%#40–15.0%#40Epoch AI Benchmarking Hub
AA-Omniscience: accuracynot in index–52.0%#53–Artificial Analysis
AA-Omniscience: non-hallucinationnot in index–50.0%#115–Artificial Analysis

Instruction following

Benchmarkxhighnot statedSourceTrend
LiveBench Languagenot in index74.3%#52–LiveBench
LiveBench Instruction Followingnot in index69.6%#31–LiveBench
MultiChallengeeffort not stated–75.3%#3Scale AI SEAL
Arena Instruction Followingnot in indexeffort not stated–1473#31Arena (LMArena)

Human preference

Benchmarknot statedSourceTrend
Arena Text1490#13Arena (LMArena)
EQ-Bench 41260#8EQ-Bench
Arena Creative Writingnot in index1444#53Arena (LMArena)
Arena Multi-turnnot in index1495#15Arena (LMArena)
Arena Longer Queriesnot in index1481#45Arena (LMArena)

Multimodal

Benchmarkxhighnot statedSourceTrend
Arena Visioneffort not stated–1293#26Arena (LMArena)
MMMU-Pro (Vals)not in index86.6%#18–Vals AI
MortgageTaxnot in index66.1%#36–Vals AI
SAGEnot in index45.6%#39–Vals AI
VTBnot in indexeffort not stated–44.8%#1Scale AI SEAL

Long context

Benchmarkxhighnot statedSourceTrend
AA-LCR77.7%#127–Artificial Analysis
Arena Documentnot in indexeffort not stated–1480#12Arena (LMArena)

Composite

Benchmarkxhighnot statedSourceTrend
Epoch Capabilities Indexnot in indexeffort not stated–154.1#43Epoch AI Benchmarking Hub
LiveBench 1.0not in index75.3%#37–LiveBench
AA Intelligence Index v4.3.233.7#101–Artificial Analysis
Vals Multimodal Indexnot in index66.7%#11–Vals AI

Safety & honesty

Benchmarknot statedSourceTrend
FORTRESSnot in index12.4%#63Scale AI SEAL

Where it wins

Benchmarks where this configuration ranks in the top five of every configuration measured.

Where to run it

Every provider serving this model through OpenRouter, with throughput and first-token latency measured on live traffic over the last 30 minutes and each provider’s own price. Purple marks the best in each column.

ProviderSpeedFirst tokenInput $/MOutput $/MContextQuantisation
Meta214 tok/s1.68 s$1.25$4.251.0M–

What a task costs

Estimates from list price, output speed and time to first answer for the best configuration. “With caching” assumes three-quarters of the input is served from the prompt cache at $0.150 per 1M. Reasoning tokens are not modelled.

WorkloadTokens in / outCostWith cachingTime
Chat reply400 / 300$0.0018$0.00142.9 s
Summarize a 30-page report12,000 / 600$0.018$0.00774.2 s
Code edit6,000 / 1,500$0.014$0.00898.0 s
Agentic coding session60,000 / 4,000$0.092$0.04318.6 s
Structured extraction2,000 / 200$0.0034$0.00172.5 s

More from Meta

New this month

Compare Muse Spark 1.1 with…

See also

Data as of 21 Oct 2026. Compare these configurations.

Cite as: BenchLeader, “Muse Spark 1.1: benchmarks, pricing, speed and rank”, https://www.benchleader.com/models/muse-spark-1-1, data as of 21 Oct 2026.