Model comparison

Gemini 2.5 Flash vs Muse Spark

Muse Spark is the stronger model overall, scoring 50.6 to 39.3 on the Noometry Index.

Last verified . 23 shared benchmarks.

Gemini 2.5 Flash Google

39.3

Rank #170 Confirmed

Muse Spark Meta

50.6

Rank #46 Confirmed

Summary

  • They share 23 benchmarks with published results for both. Gemini 2.5 Flash scores higher in 1 category and Muse Spark in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Muse Spark leads 65.7 to 36.4.
  • The biggest single-benchmark swing is Humanity's Last Exam: 12.1% for Gemini 2.5 Flash and 40.6% for Muse Spark.

Side by side

Gemini 2.5 Flash and Muse Spark specifications
Gemini 2.5 FlashMuse Spark
ProviderGoogleMeta
Noometry Index39.350.6
Released2025-04-172026-04-08
WeightsProprietaryProprietary
Context window1.05M—
Max output66K—
Input $ / M tokens$0.30—
Output $ / M tokens$2.50—
Results tracked5427

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark leads

Gemini 2.5 Flash: 35.8 (#220), Muse Spark: 46.2 (#69)

Coding benchmarks
BenchmarkGemini 2.5 FlashMuse Spark
LMArena Coding14241481
SWE-bench Verified (bash only)28.7%—
Aider Polyglot55.1%—
SciCode—51.5%
WeirdML41.9%—
ALE-Bench661.88—

Agentic & Tool Use Not comparable

Gemini 2.5 Flash: 30.8 (#74), Muse Spark: —

Agentic & Tool Use benchmarks
BenchmarkGemini 2.5 FlashMuse Spark
Terminal-Bench17.1%—
Berkeley Function Calling Leaderboard56.2%—
TheAgentCompany41.1%—
BALROG33.5%—
Vending-Bench 2548.84—

Reasoning Muse Spark leads

Gemini 2.5 Flash: 18.1 (#286), Muse Spark: 35.9 (#67)

Reasoning benchmarks
BenchmarkGemini 2.5 FlashMuse Spark
CritPt1.1%11.3%
LMArena Hard Prompts14221474
Epoch Capabilities Index143.03152.04
ARC-AGI-22.5%—
SimpleBench41.2%—
Kagi LLM Benchmark56.8%—
ARC-AGI-133.3%—
EnigmaEval2.7%—
DTBench76.5%—
LMCA27.5%—
ForecastBench60.6—

Math Muse Spark leads

Gemini 2.5 Flash: 39.9 (#98), Muse Spark: 47.8 (#66)

Math benchmarks
BenchmarkGemini 2.5 FlashMuse Spark
OTIS Mock AIME 2024-202573.1%88.9%
LMArena Math14151455
FrontierMath (Feb 2025 set)4.8%39%
FrontierMath Tier 4 (v1)4.2%14.6%
ProofBench—17%
Omni-MATH38.5%—

Knowledge Muse Spark leads

Gemini 2.5 Flash: 36.4 (#168), Muse Spark: 65.7 (#13)

Knowledge benchmarks
BenchmarkGemini 2.5 FlashMuse Spark
Humanity's Last Exam12.1%40.6%
LMArena Expert14261457
GPQA Diamond—89.8%
MMLU-Pro63.9%—
Confabulations16.8%—
Vectara Hallucination Rate7.8%—
GPQA (HELM)39%—

Multimodal Muse Spark leads

Gemini 2.5 Flash: 41.8 (#32), Muse Spark: 43.4 (#24)

Multimodal benchmarks
BenchmarkGemini 2.5 FlashMuse Spark
LMArena Vision12531306
GeoBench76%—
VPCT46.2%—
LMArena Document—1444
SpatialViz-Bench36.9%—

Multilingual Muse Spark leads

Gemini 2.5 Flash: 52.3 (#88), Muse Spark: 56.1 (#24)

Multilingual benchmarks
BenchmarkGemini 2.5 FlashMuse Spark
LMArena Non-English14091464
LMArena Chinese14501509
LMArena French14331497
LMArena German14181497
LMArena Korean13851459
LMArena Russian14151466
LMArena Spanish14211472
LMArena Japanese1405—

Instruction Following Too close to call

Gemini 2.5 Flash: 75.7 (#54), Muse Spark: 75.9 (#51)

Instruction Following benchmarks
BenchmarkGemini 2.5 FlashMuse Spark
LMArena Instruction Following14051442
IFEval89.8%—

Long Context Gemini 2.5 Flash leads

Gemini 2.5 Flash: 47.5 (#17), Muse Spark: 44.4 (#69)

Long Context benchmarks
BenchmarkGemini 2.5 FlashMuse Spark
LMArena Longer Query14191451
Fiction.LiveBench77.8%—

Writing & Preference Muse Spark leads

Gemini 2.5 Flash: 53.8 (#157), Muse Spark: 66.0 (#39)

Writing & Preference benchmarks
BenchmarkGemini 2.5 FlashMuse Spark
LMArena Text14171474
LMArena Creative Writing14001459
LMArena Multi-Turn14081477
Short-Story Creative Writing76.5%—
EQ-Bench Creative Writing1137—
WildBench81.7%—

Frequently asked questions

Is Gemini 2.5 Flash better than Muse Spark?

Muse Spark is the stronger model overall, scoring 50.6 to 39.3 on the Noometry Index.

Is Gemini 2.5 Flash or Muse Spark better for coding?

Muse Spark scores higher on coding benchmarks: 46.2 versus 35.8 in the Noometry coding category.

How many benchmarks do Gemini 2.5 Flash and Muse Spark share?

23 benchmarks have published results for both models. Gemini 2.5 Flash has 54 scored results on Noometry and Muse Spark has 27.

Related comparisons

Go deeper