Model comparison

Gemini 2.5 Pro vs Muse Spark 1.1

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 44.9 on the Noometry Index.

Last verified . 28 shared benchmarks.

Gemini 2.5 Pro Google

44.9

Rank #67 Confirmed

Muse Spark 1.1 Meta

49.9

Rank #43 Confirmed

Summary

  • They share 28 benchmarks with published results for both. Gemini 2.5 Pro scores higher in 3 categories and Muse Spark 1.1 in 7 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Muse Spark 1.1 leads 45.9 to 28.8.
  • The biggest single-benchmark swing is τ²-bench Banking: 13.7% for Gemini 2.5 Pro and 40.5% for Muse Spark 1.1.
  • Muse Spark 1.1 is cheaper at $1.25 / $4.25 per million input/output tokens, against $1.25 / $10 for Gemini 2.5 Pro.

Side by side

Gemini 2.5 Pro and Muse Spark 1.1 specifications
Gemini 2.5 ProMuse Spark 1.1
ProviderGoogleMeta
Noometry Index44.949.9
Released2025-03-252026-04-08
WeightsProprietaryProprietary
Context window1.05M1.05M
Max output66K131K
Input $ / M tokens$1.25$1.25
Output $ / M tokens$10$4.25
Results tracked7836

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.1 leads

Gemini 2.5 Pro: 42.8 (#86), Muse Spark 1.1: 50.8 (#38)

Coding benchmarks
BenchmarkGemini 2.5 ProMuse Spark 1.1
LMArena WebDev12271542
SciCode42.8%58.8%
LMArena Coding14521497
SWE-bench Verified57.6%—
DeepSWE—53.3%
SWE-bench Verified (bash only)53.6%—
Aider Polyglot83.1%—
GSO3.9%—
WeirdML54%—
LiveBench Coding85.9%—
CadEval64%—
ALE-Bench785.52—
AlgoTune1.51—

Agentic & Tool Use Muse Spark 1.1 leads

Gemini 2.5 Pro: 29.1 (#81), Muse Spark 1.1: 33.9 (#45)

Agentic & Tool Use benchmarks
BenchmarkGemini 2.5 ProMuse Spark 1.1
τ²-bench Banking13.7%40.5%
Vending-Bench 2573.646,520
Terminal-Bench32.6%—
GDPval23.3%—
Remote Labor Index0.8%—
TheAgentCompany30.3%—
DeepResearch Bench42.8%—
BALROG43.3%—
GBAEval—7.9%
GDP.pdf—15%
LMArena Search1142—
METR Time Horizons55.4%—

Reasoning Muse Spark 1.1 leads

Gemini 2.5 Pro: 28.8 (#85), Muse Spark 1.1: 45.9 (#41)

Reasoning benchmarks
BenchmarkGemini 2.5 ProMuse Spark 1.1
CritPt2%15.1%
LMArena Hard Prompts14551486
DTBench82.4%94.4%
LMCA34.8%49.9%
Epoch Capabilities Index145.32154.32
ARC-AGI-24.9%—
SimpleBench62.4%—
Kagi LLM Benchmark70.3%—
NYT Connections (extended)—84.9%
ARC-AGI-141%—
Chess Puzzles20%—
EnigmaEval5.6%—
LiveBench Reasoning89.8%—
LiveBench Data Analysis79.9%—
Surface Evolver Bench—52.5%
ForecastBench61.3—
LiveBench82.3%—

Math Muse Spark 1.1 leads

Gemini 2.5 Pro: 31.9 (#191), Muse Spark 1.1: 44.0 (#67)

Math benchmarks
BenchmarkGemini 2.5 ProMuse Spark 1.1
LMArena Math14501477
FrontierMath (Tiers 1-3)24.6%—
FrontierMath Tier 40%—
OTIS Mock AIME 2024-202584.7%—
ProofBench—39%
Omni-MATH41.6%—
LiveBench Math90.2%—
MATH Level 595.9%—
FrontierMath (Feb 2025 set)14.1%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Gemini 2.5 Pro leads

Gemini 2.5 Pro: 55.8 (#41), Muse Spark 1.1: 52.8 (#55)

Knowledge benchmarks
BenchmarkGemini 2.5 ProMuse Spark 1.1
LMArena Expert14521480
GPQA Diamond85.3%—
Humanity's Last Exam21.6%—
SimpleQA Verified—57.8%
MMLU-Pro86.3%—
Confabulations10.6%—
Vectara Hallucination Rate7%—
GPQA (HELM)74.9%—

Multimodal Gemini 2.5 Pro leads

Gemini 2.5 Pro: 44.5 (#16), Muse Spark 1.1: 41.9 (#28)

Multimodal benchmarks
BenchmarkGemini 2.5 ProMuse Spark 1.1
LMArena Vision12631292
LMArena Document14211465
GeoBench86%—
VPCT48%—
SpatialViz-Bench44.7%—

Multilingual Muse Spark 1.1 leads

Gemini 2.5 Pro: 55.5 (#30), Muse Spark 1.1: 56.8 (#16)

Multilingual benchmarks
BenchmarkGemini 2.5 ProMuse Spark 1.1
LMArena Non-English14521471
LMArena Chinese15071518
LMArena French14731494
LMArena German14871466
LMArena Japanese14621445
LMArena Korean14351459
LMArena Russian14601482
LMArena Spanish14731471

Instruction Following Muse Spark 1.1 leads

Gemini 2.5 Pro: 75.2 (#71), Muse Spark 1.1: 76.8 (#36)

Instruction Following benchmarks
BenchmarkGemini 2.5 ProMuse Spark 1.1
LMArena Instruction Following14361457
LiveBench Instruction Following80.6%—
IFEval84%—

Long Context Gemini 2.5 Pro leads

Gemini 2.5 Pro: 59.7 (#5), Muse Spark 1.1: 44.8 (#55)

Long Context benchmarks
BenchmarkGemini 2.5 ProMuse Spark 1.1
LMArena Longer Query14491463
Fiction.LiveBench91.7%—

Writing & Preference Muse Spark 1.1 leads

Gemini 2.5 Pro: 63.9 (#60), Muse Spark 1.1: 73.6 (#11)

Writing & Preference benchmarks
BenchmarkGemini 2.5 ProMuse Spark 1.1
LMArena Text14581479
LMArena Creative Writing14531440
EQ-Bench Creative Writing14211927
LMArena Multi-Turn14531484
Short-Story Creative Writing83.8%—
WildBench85.7%—
EQ-Bench 4—1260
LiveBench Language67.8%—

Frequently asked questions

Is Gemini 2.5 Pro better than Muse Spark 1.1?

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 44.9 on the Noometry Index.

Which is cheaper, Gemini 2.5 Pro or Muse Spark 1.1?

Muse Spark 1.1 is cheaper. It lists at $1.25 per million input tokens and $4.25 per million output tokens; Gemini 2.5 Pro lists at $1.25 and $10.

Is Gemini 2.5 Pro or Muse Spark 1.1 better for coding?

Muse Spark 1.1 scores higher on coding benchmarks: 50.8 versus 42.8 in the Noometry coding category.

Which has the bigger context window?

Both accept 1.05M tokens.

How many benchmarks do Gemini 2.5 Pro and Muse Spark 1.1 share?

28 benchmarks have published results for both models. Gemini 2.5 Pro has 78 scored results on Noometry and Muse Spark 1.1 has 36.

Related comparisons

Go deeper