Noometry

Model comparison

Gemini 1.5 Flash 8B vs Muse Spark 1.2

Muse Spark 1.2 is the stronger model overall, scoring 50.3 to 29.9 on the Noometry Index.

Last verified . 16 shared benchmarks.

Gemini 1.5 Flash 8B Google

29.9

Rank #301 Confirmed

Muse Spark 1.2 Meta

50.3

Rank #48 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Gemini 1.5 Flash 8B scores higher in 0 categories and Muse Spark 1.2 in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Muse Spark 1.2 leads 54.1 to 16.0.
  • The biggest single-benchmark swing is DTBench: 50% for Gemini 1.5 Flash 8B and 94.7% for Muse Spark 1.2.

Side by side

Gemini 1.5 Flash 8BMuse Spark 1.2
ProviderGoogleMeta
Noometry Index29.950.3
Released2024-10-032026-08-05
WeightsProprietaryProprietary
Context window—1.05M
Max output—131K
Input $ / M tokens—$1.25
Output $ / M tokens—$4.25
Results tracked2131

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.2 leads

Gemini 1.5 Flash 8B: 35.5 (#225), Muse Spark 1.2: 49.2 (#51)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.2
LMArena Coding12181495
DeepSWE—54.9%
LMArena WebDev—1533
FrontierSWE—12%
SciCode—56.4%
WeirdML—60.3%

Agentic & Tool Use Not comparable

Gemini 1.5 Flash 8B: —, Muse Spark 1.2: 29.4 (#87)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.2
APEX-Agents—36.4%
GDP.pdf—16%

Reasoning Muse Spark 1.2 leads

Gemini 1.5 Flash 8B: 20.0 (#244), Muse Spark 1.2: 51.3 (#34)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.2
LMArena Hard Prompts12091486
DTBench50%94.7%
SimpleBench—74.5%
NYT Connections (extended)—79.2%
CritPt—17.7%
LMCA—48.4%
Epoch Capabilities Index—154.87

Math Muse Spark 1.2 leads

Gemini 1.5 Flash 8B: 14.2 (#302), Muse Spark 1.2: 46.4 (#70)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.2
LMArena Math12071471
OTIS Mock AIME 2024-20254.6%—
ProofBench—43%

Knowledge Muse Spark 1.2 leads

Gemini 1.5 Flash 8B: 16.0 (#289), Muse Spark 1.2: 54.1 (#53)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.2
LMArena Expert11851480
GPQA Diamond33%—
SimpleQA Verified—60.3%

Multimodal Muse Spark 1.2 leads

Gemini 1.5 Flash 8B: 28.2 (#115), Muse Spark 1.2: 43.4 (#25)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.2
LMArena Vision10441305

Multilingual Muse Spark 1.2 leads

Gemini 1.5 Flash 8B: 38.5 (#229), Muse Spark 1.2: 57.1 (#11)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.2
LMArena Non-English12151478
LMArena Chinese12311511
LMArena French12341513
LMArena Russian12361487
LMArena Spanish12121498
LMArena German1206—
LMArena Japanese1150—
LMArena Korean1140—

Instruction Following Muse Spark 1.2 leads

Gemini 1.5 Flash 8B: 62.8 (#236), Muse Spark 1.2: 76.7 (#36)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.2
LMArena Instruction Following11991461

Long Context Muse Spark 1.2 leads

Gemini 1.5 Flash 8B: 37.0 (#225), Muse Spark 1.2: 45.2 (#48)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.2
LMArena Longer Query12191475

Writing & Preference Muse Spark 1.2 leads

Gemini 1.5 Flash 8B: 42.8 (#232), Muse Spark 1.2: 72.3 (#14)

BenchmarkGemini 1.5 Flash 8BMuse Spark 1.2
LMArena Text12261482
LMArena Creative Writing12181449
LMArena Multi-Turn11851494
EQ-Bench Creative Writing—1840

Frequently asked questions

Is Gemini 1.5 Flash 8B better than Muse Spark 1.2?

Muse Spark 1.2 is the stronger model overall, scoring 50.3 to 29.9 on the Noometry Index.

Is Gemini 1.5 Flash 8B or Muse Spark 1.2 better for coding?

Muse Spark 1.2 scores higher on coding benchmarks: 49.2 versus 35.5 in the Noometry coding category.

How many benchmarks do Gemini 1.5 Flash 8B and Muse Spark 1.2 share?

16 benchmarks have published results for both models. Gemini 1.5 Flash 8B has 21 scored results on Noometry and Muse Spark 1.2 has 31.

Related comparisons

Go deeper