Model comparison

Gemini 2.0 Pro vs Magistral Medium

Gemini 2.0 Pro is the stronger model overall, scoring 39.1 to 35.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemini 2.0 Pro Google

39.1

Rank #173 Confirmed

Magistral Medium Mistral AI

35.2

Rank #227 Confirmed

Summary

  • The widest gap is in reasoning, where Gemini 2.0 Pro leads 22.3 to 8.6.
  • Magistral Medium has downloadable open weights; the other is API-only.

Side by side

Gemini 2.0 Pro and Magistral Medium specifications
Gemini 2.0 ProMagistral Medium
ProviderGoogleMistral AI
Noometry Index39.135.2
Released2025-02-052025-03-17
WeightsProprietaryOpen
Context window—262K
Max output—16K
Input $ / M tokens—$2
Output $ / M tokens—$5
Results tracked1422

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Magistral Medium leads

Gemini 2.0 Pro: 37.8 (#187), Magistral Medium: 39.1 (#161)

Coding benchmarks
BenchmarkGemini 2.0 ProMagistral Medium
Aider Polyglot35.6%—
SciCode—39.2%
LiveBench Coding63.5%—
LMArena Coding—1319

Reasoning Gemini 2.0 Pro leads

Gemini 2.0 Pro: 22.3 (#198), Magistral Medium: 8.6 (#348)

Reasoning benchmarks
BenchmarkGemini 2.0 ProMagistral Medium
ARC-AGI-2—0%
Kagi LLM Benchmark—16.2%
ARC-AGI-1—6.1%
CritPt—0.3%
EnigmaEval0.7%—
LiveBench Reasoning60.1%—
LMArena Hard Prompts—1267
LiveBench Data Analysis68%—
Epoch Capabilities Index135.06—
LiveBench65.1%—

Math Gemini 2.0 Pro leads

Gemini 2.0 Pro: 39.7 (#100), Magistral Medium: 35.1 (#189)

Math benchmarks
BenchmarkGemini 2.0 ProMagistral Medium
LiveBench Math71%—
LMArena Math—1250
MATH Level 583.5%—

Knowledge Gemini 2.0 Pro leads

Gemini 2.0 Pro: 36.5 (#167), Magistral Medium: 33.5 (#202)

Knowledge benchmarks
BenchmarkGemini 2.0 ProMagistral Medium
GPQA Diamond65.7%—
Confabulations18.4%—
LMArena Expert—1223

Multilingual Not comparable

Gemini 2.0 Pro: —, Magistral Medium: 39.6 (#224)

Multilingual benchmarks
BenchmarkGemini 2.0 ProMagistral Medium
LMArena Non-English—1232
LMArena Chinese—1227
LMArena French—1267
LMArena German—1248
LMArena Japanese—1175
LMArena Korean—1125
LMArena Russian—1224
LMArena Spanish—1271

Instruction Following Gemini 2.0 Pro leads

Gemini 2.0 Pro: 75.5 (#59), Magistral Medium: 66.0 (#211)

Instruction Following benchmarks
BenchmarkGemini 2.0 ProMagistral Medium
LiveBench Instruction Following83.4%—
LMArena Instruction Following—1254

Long Context Magistral Medium leads

Gemini 2.0 Pro: 29.2 (#292), Magistral Medium: 39.3 (#183)

Long Context benchmarks
BenchmarkGemini 2.0 ProMagistral Medium
Fiction.LiveBench41.7%—
LMArena Longer Query—1295

Writing & Preference Gemini 2.0 Pro leads

Gemini 2.0 Pro: 52.7 (#165), Magistral Medium: 46.3 (#219)

Writing & Preference benchmarks
BenchmarkGemini 2.0 ProMagistral Medium
LMArena Text—1255
LMArena Creative Writing—1245
LMArena Multi-Turn—1275
LiveBench Language44.9%—

Frequently asked questions

Is Gemini 2.0 Pro better than Magistral Medium?

Gemini 2.0 Pro is the stronger model overall, scoring 39.1 to 35.2 on the Noometry Index.

Is Gemini 2.0 Pro or Magistral Medium better for coding?

Magistral Medium scores higher on coding benchmarks: 39.1 versus 37.8 in the Noometry coding category.

How many benchmarks do Gemini 2.0 Pro and Magistral Medium share?

0 benchmarks have published results for both models. Gemini 2.0 Pro has 14 scored results on Noometry and Magistral Medium has 22.

Related comparisons

Go deeper