Noometry

Model comparison

Gemma 2 27B vs Muse Spark

Muse Spark is the stronger model overall, scoring 50.6 to 29.4 on the Noometry Index.

Last verified . 19 shared benchmarks.

Gemma 2 27B Google

29.4

Rank #312 Confirmed

Muse Spark Meta

50.6

Rank #46 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Gemma 2 27B scores higher in 0 categories and Muse Spark in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Muse Spark leads 65.7 to 19.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.4% for Gemma 2 27B and 88.9% for Muse Spark.
  • Gemma 2 27B has downloadable open weights; the other is API-only.

Side by side

Gemma 2 27BMuse Spark
ProviderGoogleMeta
Noometry Index29.450.6
Released2024-06-242026-04-08
WeightsOpenProprietary
Context window8K—
Max output2K—
Input $ / M tokens$0.65—
Output $ / M tokens$0.65—
Results tracked3427

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark leads

Gemma 2 27B: 34.1 (#246), Muse Spark: 46.2 (#69)

BenchmarkGemma 2 27BMuse Spark
LMArena Coding12111481
SciCode—51.5%
BigCodeBench Instruct42.8%—
LiveBench Coding36%—
BigCodeBench Complete52.5%—

Reasoning Muse Spark leads

Gemma 2 27B: 15.3 (#315), Muse Spark: 35.9 (#67)

BenchmarkGemma 2 27BMuse Spark
LMArena Hard Prompts11981474
Epoch Capabilities Index122.08152.04
CritPt—11.3%
LiveBench Reasoning28.1%—
DTBench48%—
LiveBench Data Analysis47.9%—
LMCA7.1%—
LiveBench38.2%—

Math Muse Spark leads

Gemma 2 27B: 10.7 (#311), Muse Spark: 47.8 (#66)

BenchmarkGemma 2 27BMuse Spark
OTIS Mock AIME 2024-20251.4%88.9%
LMArena Math12121455
ProofBench—17%
LiveBench Math26.5%—
MATH Level 527.9%—
FrontierMath (Feb 2025 set)—39%
FrontierMath Tier 4 (v1)—14.6%

Knowledge Muse Spark leads

Gemma 2 27B: 19.0 (#280), Muse Spark: 65.7 (#13)

BenchmarkGemma 2 27BMuse Spark
GPQA Diamond36.5%89.8%
LMArena Expert11721457
Humanity's Last Exam—40.6%
Confabulations27.1%—
MMLU75.7%—

Multimodal Not comparable

Gemma 2 27B: —, Muse Spark: 43.4 (#24)

BenchmarkGemma 2 27BMuse Spark
LMArena Vision—1306
LMArena Document—1444

Multilingual Muse Spark leads

Gemma 2 27B: 38.6 (#226), Muse Spark: 56.1 (#24)

BenchmarkGemma 2 27BMuse Spark
LMArena Non-English12171464
LMArena Chinese12211509
LMArena French12471497
LMArena German12091497
LMArena Korean11741459
LMArena Russian12341466
LMArena Spanish12281472
LMArena Japanese1175—

Instruction Following Muse Spark leads

Gemma 2 27B: 60.5 (#249), Muse Spark: 75.9 (#51)

BenchmarkGemma 2 27BMuse Spark
LMArena Instruction Following12061442
LiveBench Instruction Following58.1%—

Long Context Muse Spark leads

Gemma 2 27B: 37.3 (#218), Muse Spark: 44.4 (#69)

BenchmarkGemma 2 27BMuse Spark
LMArena Longer Query12311451

Writing & Preference Muse Spark leads

Gemma 2 27B: 44.2 (#225), Muse Spark: 66.0 (#39)

BenchmarkGemma 2 27BMuse Spark
LMArena Text12311474
LMArena Creative Writing12411459
LMArena Multi-Turn12241477
LiveBench Language32.6%—

Frequently asked questions

Is Gemma 2 27B better than Muse Spark?

Muse Spark is the stronger model overall, scoring 50.6 to 29.4 on the Noometry Index.

Is Gemma 2 27B or Muse Spark better for coding?

Muse Spark scores higher on coding benchmarks: 46.2 versus 34.1 in the Noometry coding category.

How many benchmarks do Gemma 2 27B and Muse Spark share?

19 benchmarks have published results for both models. Gemma 2 27B has 34 scored results on Noometry and Muse Spark has 27.

Related comparisons

Go deeper