Model comparison

Gemma 3 27B vs Muse Spark 1.1

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 30.8 on the Noometry Index. Gemma 3 27B costs 20× less per token, which makes it the better buy when Muse Spark 1.1's lead doesn't matter for your workload.

Last verified . 24 shared benchmarks.

Gemma 3 27B Google

30.8

Rank #284 Confirmed

Muse Spark 1.1 Meta

49.9

Rank #51 Confirmed

Summary

  • They share 24 benchmarks with published results for both. Gemma 3 27B scores higher in 0 categories and Muse Spark 1.1 in 10 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Muse Spark 1.1 leads 47.1 to 16.7.
  • The biggest single-benchmark swing is DTBench: 52.5% for Gemma 3 27B and 94.4% for Muse Spark 1.1.
  • Gemma 3 27B is cheaper at $0.08 / $0.16 per million input/output tokens, against $1.25 / $4.25 for Muse Spark 1.1.
  • Muse Spark 1.1 accepts more context: 1.05M tokens versus 131K.
  • Gemma 3 27B has downloadable open weights; the other is API-only.

Side by side

Gemma 3 27B and Muse Spark 1.1 specifications
Gemma 3 27BMuse Spark 1.1
ProviderGoogleMeta
Noometry Index30.849.9
Released2025-03-112026-04-08
WeightsOpenProprietary
Context window131K1.05M
Max output8K131K
Input $ / M tokens$0.08$1.25
Output $ / M tokens$0.16$4.25
Results tracked4337

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.1 leads

Gemma 3 27B: 22.5 (#334), Muse Spark 1.1: 51.3 (#40)

Coding benchmarks
BenchmarkGemma 3 27BMuse Spark 1.1
SciCode21.2%58.8%
LMArena Coding13221498
DeepSWE—53.3%
Aider Polyglot4.9%—
LMArena WebDev—1542
LiveBench Coding39.9%—

Agentic & Tool Use Muse Spark 1.1 leads

Gemma 3 27B: 25.1 (#110), Muse Spark 1.1: 30.8 (#73)

Agentic & Tool Use benchmarks
BenchmarkGemma 3 27BMuse Spark 1.1
APEX-Agents—31.8%
Berkeley Function Calling Leaderboard29.5%—
τ²-bench Banking—40.5%
GBAEval—7.9%
GDP.pdf—15%
Vending-Bench 2—6,520

Reasoning Muse Spark 1.1 leads

Gemma 3 27B: 16.7 (#301), Muse Spark 1.1: 47.1 (#44)

Reasoning benchmarks
BenchmarkGemma 3 27BMuse Spark 1.1
CritPt0%15.1%
LMArena Hard Prompts13401486
DTBench52.5%94.4%
LMCA12.3%49.9%
Epoch Capabilities Index130.04154.21
Kagi LLM Benchmark40.4%—
NYT Connections (extended)—84.9%
Chess Puzzles0%—
LiveBench Reasoning43.8%—
LiveBench Data Analysis51.5%—
Surface Evolver Bench—52.5%
LiveBench50%—

Math Muse Spark 1.1 leads

Gemma 3 27B: 25.9 (#265), Muse Spark 1.1: 45.5 (#76)

Math benchmarks
BenchmarkGemma 3 27BMuse Spark 1.1
LMArena Math13121483
OTIS Mock AIME 2024-202522.5%—
ProofBench—39%
LiveBench Math55.4%—
MATH Level 574%—

Knowledge Muse Spark 1.1 leads

Gemma 3 27B: 25.5 (#261), Muse Spark 1.1: 53.1 (#59)

Knowledge benchmarks
BenchmarkGemma 3 27BMuse Spark 1.1
LMArena Expert13041478
GPQA Diamond47.7%—
SimpleQA Verified—57.8%
Confabulations40.3%—
Vectara Hallucination Rate7.4%—

Multimodal Muse Spark 1.1 leads

Gemma 3 27B: 32.6 (#100), Muse Spark 1.1: 42.6 (#29)

Multimodal benchmarks
BenchmarkGemma 3 27BMuse Spark 1.1
LMArena Vision11641293
GeoBench52%—
LMArena Document—1465

Multilingual Muse Spark 1.1 leads

Gemma 3 27B: 46.9 (#155), Muse Spark 1.1: 56.7 (#17)

Multilingual benchmarks
BenchmarkGemma 3 27BMuse Spark 1.1
LMArena Non-English13341472
LMArena Chinese13461518
LMArena French13681494
LMArena German13621466
LMArena Japanese12871451
LMArena Korean13081458
LMArena Russian13491483
LMArena Spanish13491464

Instruction Following Muse Spark 1.1 leads

Gemma 3 27B: 70.6 (#160), Muse Spark 1.1: 76.5 (#39)

Instruction Following benchmarks
BenchmarkGemma 3 27BMuse Spark 1.1
LMArena Instruction Following13211457
LiveBench Instruction Following74.9%—

Long Context Muse Spark 1.1 leads

Gemma 3 27B: 27.6 (#293), Muse Spark 1.1: 44.8 (#58)

Long Context benchmarks
BenchmarkGemma 3 27BMuse Spark 1.1
LMArena Longer Query13331462
Fiction.LiveBench33.3%—

Writing & Preference Muse Spark 1.1 leads

Gemma 3 27B: 52.5 (#168), Muse Spark 1.1: 73.4 (#11)

Writing & Preference benchmarks
BenchmarkGemma 3 27BMuse Spark 1.1
LMArena Text13581479
LMArena Creative Writing13461437
EQ-Bench Creative Writing12661927
LMArena Multi-Turn13451485
Short-Story Creative Writing79.9%—
EQ-Bench 4—1260
LiveBench Language34.6%—

Frequently asked questions

Is Gemma 3 27B better than Muse Spark 1.1?

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 30.8 on the Noometry Index. Gemma 3 27B costs 20× less per token, which makes it the better buy when Muse Spark 1.1's lead doesn't matter for your workload.

Which is cheaper, Gemma 3 27B or Muse Spark 1.1?

Gemma 3 27B is cheaper. It lists at $0.08 per million input tokens and $0.16 per million output tokens; Muse Spark 1.1 lists at $1.25 and $4.25.

Is Gemma 3 27B or Muse Spark 1.1 better for coding?

Muse Spark 1.1 scores higher on coding benchmarks: 51.3 versus 22.5 in the Noometry coding category.

Which has the bigger context window?

Muse Spark 1.1 does, with 1.05M tokens against 131K.

How many benchmarks do Gemma 3 27B and Muse Spark 1.1 share?

24 benchmarks have published results for both models. Gemma 3 27B has 43 scored results on Noometry and Muse Spark 1.1 has 37.

Related comparisons

Go deeper