Noometry

Model comparison

Gemma 1.1 2b IT vs Muse Spark 1.1

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 29.3 on the Noometry Index.

Last verified . 14 shared benchmarks.

Gemma 1.1 2b IT Google

29.3

Rank #313 Confirmed

Muse Spark 1.1 Meta

49.9

Rank #51 Confirmed

Summary

  • They share 14 benchmarks with published results for both. Gemma 1.1 2b IT scores higher in 0 categories and Muse Spark 1.1 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Muse Spark 1.1 leads 73.4 to 25.1.
  • Gemma 1.1 2b IT has downloadable open weights; the other is API-only.

Side by side

Gemma 1.1 2b ITMuse Spark 1.1
ProviderGoogleMeta
Noometry Index29.349.9
Released—2026-04-08
WeightsOpenProprietary
Context window—1.05M
Max output—131K
Input $ / M tokens—$1.25
Output $ / M tokens—$4.25
Results tracked1637

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.1 leads

Gemma 1.1 2b IT: 30.1 (#299), Muse Spark 1.1: 51.3 (#40)

BenchmarkGemma 1.1 2b ITMuse Spark 1.1
LMArena Coding10341498
DeepSWE—53.3%
LMArena WebDev—1542
SciCode—58.8%
HumanEval+17.7%—
MBPP+23.3%—

Agentic & Tool Use Not comparable

Gemma 1.1 2b IT: —, Muse Spark 1.1: 30.8 (#73)

BenchmarkGemma 1.1 2b ITMuse Spark 1.1
APEX-Agents—31.8%
τ²-bench Banking—40.5%
GBAEval—7.9%
GDP.pdf—15%
Vending-Bench 2—6,520

Reasoning Muse Spark 1.1 leads

Gemma 1.1 2b IT: 19.1 (#270), Muse Spark 1.1: 47.1 (#44)

BenchmarkGemma 1.1 2b ITMuse Spark 1.1
LMArena Hard Prompts10051486
NYT Connections (extended)—84.9%
CritPt—15.1%
DTBench—94.4%
LMCA—49.9%
Surface Evolver Bench—52.5%
Epoch Capabilities Index—154.21

Math Muse Spark 1.1 leads

Gemma 1.1 2b IT: 30.8 (#232), Muse Spark 1.1: 45.5 (#76)

BenchmarkGemma 1.1 2b ITMuse Spark 1.1
LMArena Math10471483
ProofBench—39%

Knowledge Muse Spark 1.1 leads

Gemma 1.1 2b IT: 26.5 (#258), Muse Spark 1.1: 53.1 (#59)

BenchmarkGemma 1.1 2b ITMuse Spark 1.1
LMArena Expert9701478
SimpleQA Verified—57.8%

Multimodal Not comparable

Gemma 1.1 2b IT: —, Muse Spark 1.1: 42.6 (#29)

BenchmarkGemma 1.1 2b ITMuse Spark 1.1
LMArena Vision—1293
LMArena Document—1465

Multilingual Muse Spark 1.1 leads

Gemma 1.1 2b IT: 24.6 (#289), Muse Spark 1.1: 56.7 (#17)

BenchmarkGemma 1.1 2b ITMuse Spark 1.1
LMArena Non-English9881472
LMArena Chinese10121518
LMArena German9441466
LMArena Korean8991458
LMArena Russian9901483
LMArena French—1494
LMArena Japanese—1451
LMArena Spanish—1464

Instruction Following Muse Spark 1.1 leads

Gemma 1.1 2b IT: 49.9 (#299), Muse Spark 1.1: 76.5 (#39)

BenchmarkGemma 1.1 2b ITMuse Spark 1.1
LMArena Instruction Following9921457

Long Context Muse Spark 1.1 leads

Gemma 1.1 2b IT: 30.6 (#286), Muse Spark 1.1: 44.8 (#58)

BenchmarkGemma 1.1 2b ITMuse Spark 1.1
LMArena Longer Query10031462

Writing & Preference Muse Spark 1.1 leads

Gemma 1.1 2b IT: 25.1 (#306), Muse Spark 1.1: 73.4 (#11)

BenchmarkGemma 1.1 2b ITMuse Spark 1.1
LMArena Text10221479
LMArena Creative Writing9981437
LMArena Multi-Turn9591485
EQ-Bench Creative Writing—1927
EQ-Bench 4—1260

Frequently asked questions

Is Gemma 1.1 2b IT better than Muse Spark 1.1?

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 29.3 on the Noometry Index.

Is Gemma 1.1 2b IT or Muse Spark 1.1 better for coding?

Muse Spark 1.1 scores higher on coding benchmarks: 51.3 versus 30.1 in the Noometry coding category.

How many benchmarks do Gemma 1.1 2b IT and Muse Spark 1.1 share?

14 benchmarks have published results for both models. Gemma 1.1 2b IT has 16 scored results on Noometry and Muse Spark 1.1 has 37.

Related comparisons

Go deeper