Noometry

Model comparison

Gemini 2.0 Pro vs Mistral Medium 3.5

Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 39.1 on the Noometry Index.

Last verified . 1 shared benchmarks.

Gemini 2.0 Pro Google

39.1

Rank #173 Confirmed

Mistral Medium 3.5 Mistral AI

40.2

Rank #152 Confirmed

Summary

  • They share 1 benchmark with published results for both. Gemini 2.0 Pro scores higher in 4 categories and Mistral Medium 3.5 in 3 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in long context, where Mistral Medium 3.5 leads 43.2 to 29.2.
  • Mistral Medium 3.5 has downloadable open weights; the other is API-only.

Side by side

Gemini 2.0 ProMistral Medium 3.5
ProviderGoogleMistral AI
Noometry Index39.140.2
Released2025-02-05—
WeightsProprietaryOpen
Context window—262K
Max output—210K
Input $ / M tokens—$1.50
Output $ / M tokens—$7.50
Results tracked1422

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.0 Pro leads

Gemini 2.0 Pro: 37.8 (#187), Mistral Medium 3.5: 36.0 (#213)

BenchmarkGemini 2.0 ProMistral Medium 3.5
Aider Polyglot35.6%—
LMArena WebDev—1264
LiveBench Coding63.5%—
LMArena Coding—1461

Reasoning Gemini 2.0 Pro leads

Gemini 2.0 Pro: 22.3 (#198), Mistral Medium 3.5: 17.3 (#295)

BenchmarkGemini 2.0 ProMistral Medium 3.5
Epoch Capabilities Index135.06141.35
Kagi LLM Benchmark—41.4%
NYT Connections (extended)—12.9%
EnigmaEval0.7%—
LiveBench Reasoning60.1%—
LMArena Hard Prompts—1436
LiveBench Data Analysis68%—
LiveBench65.1%—

Math Too close to call

Gemini 2.0 Pro: 39.7 (#100), Mistral Medium 3.5: 39.1 (#113)

BenchmarkGemini 2.0 ProMistral Medium 3.5
LiveBench Math71%—
LMArena Math—1431
MATH Level 583.5%—

Knowledge Mistral Medium 3.5 leads

Gemini 2.0 Pro: 36.5 (#167), Mistral Medium 3.5: 40.0 (#126)

BenchmarkGemini 2.0 ProMistral Medium 3.5
GPQA Diamond65.7%—
Confabulations18.4%—
LMArena Expert—1432

Multimodal Not comparable

Gemini 2.0 Pro: —, Mistral Medium 3.5: 38.3 (#65)

BenchmarkGemini 2.0 ProMistral Medium 3.5
LMArena Vision—1223

Multilingual Not comparable

Gemini 2.0 Pro: —, Mistral Medium 3.5: 51.9 (#100)

BenchmarkGemini 2.0 ProMistral Medium 3.5
LMArena Non-English—1404
LMArena Chinese—1442
LMArena French—1448
LMArena German—1451
LMArena Korean—1385
LMArena Russian—1395
LMArena Spanish—1409

Instruction Following Too close to call

Gemini 2.0 Pro: 75.5 (#59), Mistral Medium 3.5: 74.6 (#90)

BenchmarkGemini 2.0 ProMistral Medium 3.5
LiveBench Instruction Following83.4%—
LMArena Instruction Following—1415

Long Context Mistral Medium 3.5 leads

Gemini 2.0 Pro: 29.2 (#292), Mistral Medium 3.5: 43.2 (#103)

BenchmarkGemini 2.0 ProMistral Medium 3.5
Fiction.LiveBench41.7%—
LMArena Longer Query—1415

Writing & Preference Mistral Medium 3.5 leads

Gemini 2.0 Pro: 52.7 (#165), Mistral Medium 3.5: 58.5 (#117)

BenchmarkGemini 2.0 ProMistral Medium 3.5
LMArena Text—1421
LMArena Creative Writing—1374
EQ-Bench 4—993
LMArena Multi-Turn—1423
LiveBench Language44.9%—

Frequently asked questions

Is Gemini 2.0 Pro better than Mistral Medium 3.5?

Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 39.1 on the Noometry Index.

Is Gemini 2.0 Pro or Mistral Medium 3.5 better for coding?

Gemini 2.0 Pro scores higher on coding benchmarks: 37.8 versus 36.0 in the Noometry coding category.

How many benchmarks do Gemini 2.0 Pro and Mistral Medium 3.5 share?

1 benchmark has published results for both models. Gemini 2.0 Pro has 14 scored results on Noometry and Mistral Medium 3.5 has 22.

Related comparisons

Go deeper