Model comparison

Gemini 2.5 Flash vs Muse Glimmer

Muse Glimmer is the stronger model overall, scoring 41.7 to 39.3 on the Noometry Index.

Last verified . 13 shared benchmarks.

Gemini 2.5 Flash Google

39.3

Rank #170 Confirmed

Muse Glimmer Meta

41.7

Rank #131 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Gemini 2.5 Flash scores higher in 4 categories and Muse Glimmer in 4 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Muse Glimmer leads 25.7 to 18.1.
  • Muse Glimmer has downloadable open weights; the other is API-only.

Side by side

Gemini 2.5 Flash and Muse Glimmer specifications
Gemini 2.5 FlashMuse Glimmer
ProviderGoogleMeta
Noometry Index39.341.7
Released2025-04-172026-08-10
WeightsProprietaryOpen
Context window1.05M—
Max output66K—
Input $ / M tokens$0.30—
Output $ / M tokens$2.50—
Results tracked5415

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Glimmer leads

Gemini 2.5 Flash: 35.8 (#220), Muse Glimmer: 40.4 (#142)

Coding benchmarks
BenchmarkGemini 2.5 FlashMuse Glimmer
LMArena Coding14241416
SWE-bench Verified (bash only)28.7%—
Aider Polyglot55.1%—
LMArena WebDev—1355
SciCode—44.9%
WeirdML41.9%—
ALE-Bench661.88—

Agentic & Tool Use Not comparable

Gemini 2.5 Flash: 30.8 (#74), Muse Glimmer: —

Agentic & Tool Use benchmarks
BenchmarkGemini 2.5 FlashMuse Glimmer
Terminal-Bench17.1%—
Berkeley Function Calling Leaderboard56.2%—
TheAgentCompany41.1%—
BALROG33.5%—
Vending-Bench 2548.84—

Reasoning Muse Glimmer leads

Gemini 2.5 Flash: 18.1 (#286), Muse Glimmer: 25.7 (#144)

Reasoning benchmarks
BenchmarkGemini 2.5 FlashMuse Glimmer
CritPt1.1%2.6%
LMArena Hard Prompts14221396
ARC-AGI-22.5%—
SimpleBench41.2%—
Kagi LLM Benchmark56.8%—
ARC-AGI-133.3%—
EnigmaEval2.7%—
DTBench76.5%—
LMCA27.5%—
Epoch Capabilities Index143.03—
ForecastBench60.6—

Math Gemini 2.5 Flash leads

Gemini 2.5 Flash: 39.9 (#98), Muse Glimmer: 38.8 (#125)

Math benchmarks
BenchmarkGemini 2.5 FlashMuse Glimmer
LMArena Math14151417
OTIS Mock AIME 2024-202573.1%—
Omni-MATH38.5%—
FrontierMath (Feb 2025 set)4.8%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Muse Glimmer leads

Gemini 2.5 Flash: 36.4 (#168), Muse Glimmer: 38.5 (#143)

Knowledge benchmarks
BenchmarkGemini 2.5 FlashMuse Glimmer
LMArena Expert14261386
Humanity's Last Exam12.1%—
MMLU-Pro63.9%—
Confabulations16.8%—
Vectara Hallucination Rate7.8%—
GPQA (HELM)39%—

Multimodal Not comparable

Gemini 2.5 Flash: 41.8 (#32), Muse Glimmer: —

Multimodal benchmarks
BenchmarkGemini 2.5 FlashMuse Glimmer
LMArena Vision1253—
GeoBench76%—
VPCT46.2%—
SpatialViz-Bench36.9%—

Multilingual Gemini 2.5 Flash leads

Gemini 2.5 Flash: 52.3 (#88), Muse Glimmer: 50.5 (#122)

Multilingual benchmarks
BenchmarkGemini 2.5 FlashMuse Glimmer
LMArena Non-English14091384
LMArena Chinese14501412
LMArena Russian14151390
LMArena French1433—
LMArena German1418—
LMArena Japanese1405—
LMArena Korean1385—
LMArena Spanish1421—

Instruction Following Gemini 2.5 Flash leads

Gemini 2.5 Flash: 75.7 (#54), Muse Glimmer: 72.6 (#135)

Instruction Following benchmarks
BenchmarkGemini 2.5 FlashMuse Glimmer
LMArena Instruction Following14051375
IFEval89.8%—

Long Context Gemini 2.5 Flash leads

Gemini 2.5 Flash: 47.5 (#17), Muse Glimmer: 42.1 (#129)

Long Context benchmarks
BenchmarkGemini 2.5 FlashMuse Glimmer
LMArena Longer Query14191382
Fiction.LiveBench77.8%—

Writing & Preference Muse Glimmer leads

Gemini 2.5 Flash: 53.8 (#157), Muse Glimmer: 57.5 (#126)

Writing & Preference benchmarks
BenchmarkGemini 2.5 FlashMuse Glimmer
LMArena Text14171389
LMArena Creative Writing14001339
LMArena Multi-Turn14081399
Short-Story Creative Writing76.5%—
EQ-Bench Creative Writing1137—
WildBench81.7%—

Frequently asked questions

Is Gemini 2.5 Flash better than Muse Glimmer?

Muse Glimmer is the stronger model overall, scoring 41.7 to 39.3 on the Noometry Index.

Is Gemini 2.5 Flash or Muse Glimmer better for coding?

Muse Glimmer scores higher on coding benchmarks: 40.4 versus 35.8 in the Noometry coding category.

How many benchmarks do Gemini 2.5 Flash and Muse Glimmer share?

13 benchmarks have published results for both models. Gemini 2.5 Flash has 54 scored results on Noometry and Muse Glimmer has 15.

Related comparisons

Go deeper