Model comparison

Gemini 1.0 Pro vs Muse Spark 1.1

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 27.1 on the Noometry Index.

Last verified . 18 shared benchmarks.

Gemini 1.0 Pro Google

27.1

Rank #327 Confirmed

Muse Spark 1.1 Meta

49.9

Rank #43 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Gemini 1.0 Pro scores higher in 0 categories and Muse Spark 1.1 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Muse Spark 1.1 leads 73.6 to 36.2.
  • The biggest single-benchmark swing is DTBench: 45.9% for Gemini 1.0 Pro and 94.4% for Muse Spark 1.1.

Side by side

Gemini 1.0 Pro and Muse Spark 1.1 specifications
Gemini 1.0 ProMuse Spark 1.1
ProviderGoogleMeta
Noometry Index27.149.9
Released2023-12-132026-04-08
WeightsProprietaryProprietary
Context window—1.05M
Max output—131K
Input $ / M tokens—$1.25
Output $ / M tokens—$4.25
Results tracked2436

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Muse Spark 1.1 leads

Gemini 1.0 Pro: 31.6 (#270), Muse Spark 1.1: 50.8 (#38)

Coding benchmarks
BenchmarkGemini 1.0 ProMuse Spark 1.1
LMArena Coding11081497
DeepSWE—53.3%
LMArena WebDev—1542
SciCode—58.8%
HumanEval+55.5%—
MBPP+61.4%—

Agentic & Tool Use Not comparable

Gemini 1.0 Pro: —, Muse Spark 1.1: 33.9 (#45)

Agentic & Tool Use benchmarks
BenchmarkGemini 1.0 ProMuse Spark 1.1
τ²-bench Banking—40.5%
GBAEval—7.9%
GDP.pdf—15%
Vending-Bench 2—6,520

Reasoning Muse Spark 1.1 leads

Gemini 1.0 Pro: 16.4 (#292), Muse Spark 1.1: 45.9 (#41)

Reasoning benchmarks
BenchmarkGemini 1.0 ProMuse Spark 1.1
LMArena Hard Prompts11091486
DTBench45.9%94.4%
Epoch Capabilities Index116.97154.32
NYT Connections (extended)—84.9%
CritPt—15.1%
LMCA—49.9%
Surface Evolver Bench—52.5%

Math Muse Spark 1.1 leads

Gemini 1.0 Pro: 8.7 (#315), Muse Spark 1.1: 44.0 (#67)

Math benchmarks
BenchmarkGemini 1.0 ProMuse Spark 1.1
LMArena Math11321477
OTIS Mock AIME 2024-20251.1%—
ProofBench—39%
MATH Level 511.2%—

Knowledge Muse Spark 1.1 leads

Gemini 1.0 Pro: 15.5 (#286), Muse Spark 1.1: 52.8 (#55)

Knowledge benchmarks
BenchmarkGemini 1.0 ProMuse Spark 1.1
LMArena Expert10591480
GPQA Diamond34%—
SimpleQA Verified—57.8%
MMLU70%—

Multimodal Not comparable

Gemini 1.0 Pro: —, Muse Spark 1.1: 41.9 (#28)

Multimodal benchmarks
BenchmarkGemini 1.0 ProMuse Spark 1.1
LMArena Vision—1292
LMArena Document—1465

Multilingual Muse Spark 1.1 leads

Gemini 1.0 Pro: 33.5 (#247), Muse Spark 1.1: 56.8 (#16)

Multilingual benchmarks
BenchmarkGemini 1.0 ProMuse Spark 1.1
LMArena Non-English11381471
LMArena Chinese11241518
LMArena French11441494
LMArena German11251466
LMArena Japanese10231445
LMArena Russian11861482
LMArena Spanish11181471
LMArena Korean—1459

Instruction Following Muse Spark 1.1 leads

Gemini 1.0 Pro: 57.9 (#262), Muse Spark 1.1: 76.8 (#36)

Instruction Following benchmarks
BenchmarkGemini 1.0 ProMuse Spark 1.1
LMArena Instruction Following11141457

Long Context Muse Spark 1.1 leads

Gemini 1.0 Pro: 34.3 (#244), Muse Spark 1.1: 44.8 (#55)

Long Context benchmarks
BenchmarkGemini 1.0 ProMuse Spark 1.1
LMArena Longer Query11321463

Writing & Preference Muse Spark 1.1 leads

Gemini 1.0 Pro: 36.2 (#259), Muse Spark 1.1: 73.6 (#11)

Writing & Preference benchmarks
BenchmarkGemini 1.0 ProMuse Spark 1.1
LMArena Text11491479
LMArena Creative Writing11301440
LMArena Multi-Turn11391484
EQ-Bench Creative Writing—1927
EQ-Bench 4—1260

Frequently asked questions

Is Gemini 1.0 Pro better than Muse Spark 1.1?

Muse Spark 1.1 is the stronger model overall, scoring 49.9 to 27.1 on the Noometry Index.

Is Gemini 1.0 Pro or Muse Spark 1.1 better for coding?

Muse Spark 1.1 scores higher on coding benchmarks: 50.8 versus 31.6 in the Noometry coding category.

How many benchmarks do Gemini 1.0 Pro and Muse Spark 1.1 share?

18 benchmarks have published results for both models. Gemini 1.0 Pro has 24 scored results on Noometry and Muse Spark 1.1 has 36.

Related comparisons

Go deeper