Noometry

Model comparison

Gemini 1.5 Flash 8B vs Muse Spark 1.1

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 29.9 on the Noometry Index.

Last verified . 19 shared benchmarks.

Gemini 1.5 Flash 8B Google

29.9

Rank #301 Confirmed

Muse Spark 1.1 Meta

49.9

Rank #51 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Gemini 1.5 Flash 8B scores higher in 0 categories and Muse Spark 1.1 in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Muse Spark 1.1 leads 53.1 to 16.0.
  • The biggest single-benchmark swing is DTBench: 50% for Gemini 1.5 Flash 8B and 94.4% for Muse Spark 1.1.

Side by side

Gemini 1.5 Flash 8BMuse Spark 1.1
ProviderGoogleMeta
Noometry Index29.949.9
Released2024-10-032026-04-08
WeightsProprietaryProprietary
Context window—1.05M
Max output—131K
Input $ / M tokens—$1.25
Output $ / M tokens—$4.25
Results tracked2137

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.1 leads

Gemini 1.5 Flash 8B: 35.5 (#225), Muse Spark 1.1: 51.3 (#40)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.1
LMArena Coding12181498
DeepSWE—53.3%
LMArena WebDev—1542
SciCode—58.8%

Agentic & Tool Use Not comparable

Gemini 1.5 Flash 8B: —, Muse Spark 1.1: 30.8 (#73)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.1
APEX-Agents—31.8%
τ²-bench Banking—40.5%
GBAEval—7.9%
GDP.pdf—15%
Vending-Bench 2—6,520

Reasoning Muse Spark 1.1 leads

Gemini 1.5 Flash 8B: 20.0 (#244), Muse Spark 1.1: 47.1 (#44)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.1
LMArena Hard Prompts12091486
DTBench50%94.4%
NYT Connections (extended)—84.9%
CritPt—15.1%
LMCA—49.9%
Surface Evolver Bench—52.5%
Epoch Capabilities Index—154.21

Math Muse Spark 1.1 leads

Gemini 1.5 Flash 8B: 14.2 (#302), Muse Spark 1.1: 45.5 (#76)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.1
LMArena Math12071483
OTIS Mock AIME 2024-20254.6%—
ProofBench—39%

Knowledge Muse Spark 1.1 leads

Gemini 1.5 Flash 8B: 16.0 (#289), Muse Spark 1.1: 53.1 (#59)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.1
LMArena Expert11851478
GPQA Diamond33%—
SimpleQA Verified—57.8%

Multimodal Muse Spark 1.1 leads

Gemini 1.5 Flash 8B: 28.2 (#115), Muse Spark 1.1: 42.6 (#29)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.1
LMArena Vision10441293
LMArena Document—1465

Multilingual Muse Spark 1.1 leads

Gemini 1.5 Flash 8B: 38.5 (#229), Muse Spark 1.1: 56.7 (#17)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.1
LMArena Non-English12151472
LMArena Chinese12311518
LMArena French12341494
LMArena German12061466
LMArena Japanese11501451
LMArena Korean11401458
LMArena Russian12361483
LMArena Spanish12121464

Instruction Following Muse Spark 1.1 leads

Gemini 1.5 Flash 8B: 62.8 (#236), Muse Spark 1.1: 76.5 (#39)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.1
LMArena Instruction Following11991457

Long Context Muse Spark 1.1 leads

Gemini 1.5 Flash 8B: 37.0 (#225), Muse Spark 1.1: 44.8 (#58)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.1
LMArena Longer Query12191462

Writing & Preference Muse Spark 1.1 leads

Gemini 1.5 Flash 8B: 42.8 (#232), Muse Spark 1.1: 73.4 (#11)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.1
LMArena Text12261479
LMArena Creative Writing12181437
LMArena Multi-Turn11851485
EQ-Bench Creative Writing—1927
EQ-Bench 4—1260

Frequently asked questions

Is Gemini 1.5 Flash 8B better than Muse Spark 1.1?

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 29.9 on the Noometry Index.

Is Gemini 1.5 Flash 8B or Muse Spark 1.1 better for coding?

Muse Spark 1.1 scores higher on coding benchmarks: 51.3 versus 35.5 in the Noometry coding category.

How many benchmarks do Gemini 1.5 Flash 8B and Muse Spark 1.1 share?

19 benchmarks have published results for both models. Gemini 1.5 Flash 8B has 21 scored results on Noometry and Muse Spark 1.1 has 37.

Related comparisons

Go deeper