Model comparison

Gemini 1.5 Flash 8B vs Muse Spark 1.3

Muse Spark 1.3 is the stronger model overall, scoring 54.4 to 29.7 on the Noometry Index.

Last verified . 18 shared benchmarks.

Gemini 1.5 Flash 8B Google

29.7

Rank #292 Confirmed

Muse Spark 1.3 Meta

54.4

Rank #27 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Gemini 1.5 Flash 8B scores higher in 0 categories and Muse Spark 1.3 in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Muse Spark 1.3 leads 72.4 to 13.3.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.6% for Gemini 1.5 Flash 8B and 99.2% for Muse Spark 1.3.

Side by side

Gemini 1.5 Flash 8B and Muse Spark 1.3 specifications
Gemini 1.5 Flash 8BMuse Spark 1.3
ProviderGoogleMeta
Noometry Index29.754.4
Released2024-10-032026-09-02
WeightsProprietaryProprietary
Context window—1.05M
Max output—131K
Input $ / M tokens—$1.25
Output $ / M tokens—$4.25
Results tracked2134

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.3 leads

Gemini 1.5 Flash 8B: 34.9 (#221), Muse Spark 1.3: 56.1 (#18)

Coding benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
LMArena Coding12181516
CursorBench—41.6%
LMArena WebDev—1655
SciCode—59.7%

Agentic & Tool Use Not comparable

Gemini 1.5 Flash 8B: —, Muse Spark 1.3: 38.6 (#28)

Agentic & Tool Use benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
APEX-Agents—57.8%
GDP.pdf—27.6%

Reasoning Muse Spark 1.3 leads

Gemini 1.5 Flash 8B: 19.2 (#242), Muse Spark 1.3: 52.9 (#27)

Reasoning benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
LMArena Hard Prompts12101503
DTBench50%96.5%
NYT Connections (extended)—85.1%
CritPt—24.9%
Chess Puzzles—38%
Mystery Game Puzzles—25%
LMCA—53.9%
Bench to the Future 3—0.14
Epoch Capabilities Index—156.89

Math Muse Spark 1.3 leads

Gemini 1.5 Flash 8B: 13.3 (#296), Muse Spark 1.3: 72.4 (#16)

Math benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
OTIS Mock AIME 2024-20254.6%99.2%
LMArena Math12071497
FrontierMath (Tiers 1-3)—74.4%
FrontierMath Tier 4—46.3%

Knowledge Muse Spark 1.3 leads

Gemini 1.5 Flash 8B: 16.0 (#285), Muse Spark 1.3: 42.0 (#92)

Knowledge benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
LMArena Expert11851516
GPQA Diamond33%—

Multimodal Muse Spark 1.3 leads

Gemini 1.5 Flash 8B: 27.6 (#110), Muse Spark 1.3: 43.0 (#21)

Multimodal benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
LMArena Vision10441310
LMArena Document—1471

Multilingual Muse Spark 1.3 leads

Gemini 1.5 Flash 8B: 38.6 (#224), Muse Spark 1.3: 57.8 (#6)

Multilingual benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
LMArena Non-English12151485
LMArena Chinese12311527
LMArena French12331534
LMArena Korean11401513
LMArena Russian12361491
LMArena Spanish12121485
LMArena German1206—
LMArena Japanese1150—

Instruction Following Muse Spark 1.3 leads

Gemini 1.5 Flash 8B: 63.1 (#231), Muse Spark 1.3: 77.8 (#14)

Instruction Following benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
LMArena Instruction Following11991481

Long Context Muse Spark 1.3 leads

Gemini 1.5 Flash 8B: 36.9 (#220), Muse Spark 1.3: 45.7 (#29)

Long Context benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
LMArena Longer Query12191491

Writing & Preference Muse Spark 1.3 leads

Gemini 1.5 Flash 8B: 43.0 (#227), Muse Spark 1.3: 73.7 (#10)

Writing & Preference benchmarks
BenchmarkGemini 1.5 Flash 8BMuse Spark 1.3
LMArena Text12261490
LMArena Creative Writing12181450
LMArena Multi-Turn11851486
EQ-Bench Creative Writing—1906

Frequently asked questions

Is Gemini 1.5 Flash 8B better than Muse Spark 1.3?

Muse Spark 1.3 is the stronger model overall, scoring 54.4 to 29.7 on the Noometry Index.

Is Gemini 1.5 Flash 8B or Muse Spark 1.3 better for coding?

Muse Spark 1.3 scores higher on coding benchmarks: 56.1 versus 34.9 in the Noometry coding category.

How many benchmarks do Gemini 1.5 Flash 8B and Muse Spark 1.3 share?

18 benchmarks have published results for both models. Gemini 1.5 Flash 8B has 21 scored results on Noometry and Muse Spark 1.3 has 34.

Related comparisons

Go deeper