# Gemini 2.5 Pro vs Mistral Medium 3.5

> Gemini 2.5 Pro is the stronger model overall, scoring 44.9 to 39.6 on the Noometry Index.

- Canonical page: https://noometry.com/compare/gemini-2-5-pro-vs-mistral-medium-3-5
- Last updated: 2026-10-10
- Shared benchmarks: 20

## Summary

- They share 20 benchmarks with published results for both. Gemini 2.5 Pro scores higher in 8 categories and Mistral Medium 3.5 in 1 category; 8 gaps are clear of the uncertainty.
- The widest gap is in long context, where Gemini 2.5 Pro leads 59.7 to 43.2.
- The biggest single-benchmark swing is Kagi LLM Benchmark: 70.3% for Gemini 2.5 Pro and 41.4% for Mistral Medium 3.5.
- Mistral Medium 3.5 is cheaper at $1.50 / $7.50 per million input/output tokens, against $1.25 / $10 for Gemini 2.5 Pro.
- Gemini 2.5 Pro accepts more context: 1.05M tokens versus 262K.
- Mistral Medium 3.5 has downloadable open weights; the other is API-only.

## Snapshot

| | Gemini 2.5 Pro | Mistral Medium 3.5 |
|---|---|---|
| Provider | Google | Mistral AI |
| Noometry Index | 44.9 | 39.6 |
| Rank | 67 | 151 |
| Context | 1.05M | 262K |
| Input $/M | $1.25 | $1.50 |
| Output $/M | $10 | $7.50 |
| Weights | Proprietary | Open |

## Coding

- Gemini 2.5 Pro: 42.8 (#86)
- Mistral Medium 3.5: 35.7 (#208)

| Benchmark | Gemini 2.5 Pro | Mistral Medium 3.5 |
|---|---|---|
| LMArena WebDev | 1227 | 1263 |
| LMArena Coding | 1452 | 1461 |
| SWE-bench Verified | 57.6% | — |
| SWE-bench Verified (bash only) | 53.6% | — |
| Aider Polyglot | 83.1% | — |
| SciCode | 42.8% | — |
| GSO | 3.9% | — |
| WeirdML | 54% | — |
| LiveBench Coding | 85.9% | — |
| CadEval | 64% | — |
| ALE-Bench | 785.52 | — |
| AlgoTune | 1.51 | — |

## Agentic & Tool Use

- Gemini 2.5 Pro: 29.1 (#81)
- Mistral Medium 3.5: —

| Benchmark | Gemini 2.5 Pro | Mistral Medium 3.5 |
|---|---|---|
| Terminal-Bench | 32.6% | — |
| GDPval | 23.3% | — |
| Remote Labor Index | 0.8% | — |
| TheAgentCompany | 30.3% | — |
| τ²-bench Banking | 13.7% | — |
| DeepResearch Bench | 42.8% | — |
| BALROG | 43.3% | — |
| LMArena Search | 1142 | — |
| METR Time Horizons | 55.4% | — |
| Vending-Bench 2 | 573.64 | — |

## Reasoning

- Gemini 2.5 Pro: 28.8 (#85)
- Mistral Medium 3.5: 16.6 (#290)

| Benchmark | Gemini 2.5 Pro | Mistral Medium 3.5 |
|---|---|---|
| Kagi LLM Benchmark | 70.3% | 41.4% |
| LMArena Hard Prompts | 1455 | 1436 |
| Epoch Capabilities Index | 145.32 | 141.42 |
| ARC-AGI-2 | 4.9% | — |
| SimpleBench | 62.4% | — |
| NYT Connections (extended) | — | 12.9% |
| ARC-AGI-1 | 41% | — |
| CritPt | 2% | — |
| Chess Puzzles | 20% | — |
| EnigmaEval | 5.6% | — |
| LiveBench Reasoning | 89.8% | — |
| DTBench | 82.4% | — |
| LiveBench Data Analysis | 79.9% | — |
| LMCA | 34.8% | — |
| ForecastBench | 61.3 | — |
| LiveBench | 82.3% | — |

## Math

- Gemini 2.5 Pro: 31.9 (#191)
- Mistral Medium 3.5: 36.4 (#113)

| Benchmark | Gemini 2.5 Pro | Mistral Medium 3.5 |
|---|---|---|
| LMArena Math | 1450 | 1432 |
| FrontierMath (Tiers 1-3) | 24.6% | — |
| FrontierMath Tier 4 | 0% | — |
| OTIS Mock AIME 2024-2025 | 84.7% | — |
| Omni-MATH | 41.6% | — |
| LiveBench Math | 90.2% | — |
| MATH Level 5 | 95.9% | — |
| FrontierMath (Feb 2025 set) | 14.1% | — |
| FrontierMath Tier 4 (v1) | 4.2% | — |

## Knowledge

- Gemini 2.5 Pro: 55.8 (#41)
- Mistral Medium 3.5: 39.3 (#123)

| Benchmark | Gemini 2.5 Pro | Mistral Medium 3.5 |
|---|---|---|
| LMArena Expert | 1452 | 1431 |
| GPQA Diamond | 85.3% | — |
| Humanity's Last Exam | 21.6% | — |
| MMLU-Pro | 86.3% | — |
| Confabulations | 10.6% | — |
| Vectara Hallucination Rate | 7% | — |
| GPQA (HELM) | 74.9% | — |

## Multimodal

- Gemini 2.5 Pro: 44.5 (#16)
- Mistral Medium 3.5: 37.6 (#64)

| Benchmark | Gemini 2.5 Pro | Mistral Medium 3.5 |
|---|---|---|
| LMArena Vision | 1263 | 1222 |
| GeoBench | 86% | — |
| VPCT | 48% | — |
| LMArena Document | 1421 | — |
| SpatialViz-Bench | 44.7% | — |

## Multilingual

- Gemini 2.5 Pro: 55.5 (#30)
- Mistral Medium 3.5: 52.1 (#93)

| Benchmark | Gemini 2.5 Pro | Mistral Medium 3.5 |
|---|---|---|
| LMArena Non-English | 1452 | 1405 |
| LMArena Chinese | 1507 | 1443 |
| LMArena French | 1473 | 1448 |
| LMArena German | 1487 | 1453 |
| LMArena Korean | 1435 | 1387 |
| LMArena Russian | 1460 | 1396 |
| LMArena Spanish | 1473 | 1406 |
| LMArena Japanese | 1462 | — |

## Instruction Following

- Gemini 2.5 Pro: 75.2 (#71)
- Mistral Medium 3.5: 74.7 (#87)

| Benchmark | Gemini 2.5 Pro | Mistral Medium 3.5 |
|---|---|---|
| LMArena Instruction Following | 1436 | 1414 |
| LiveBench Instruction Following | 80.6% | — |
| IFEval | 84% | — |

## Long Context

- Gemini 2.5 Pro: 59.7 (#5)
- Mistral Medium 3.5: 43.2 (#101)

| Benchmark | Gemini 2.5 Pro | Mistral Medium 3.5 |
|---|---|---|
| LMArena Longer Query | 1449 | 1414 |
| Fiction.LiveBench | 91.7% | — |

## Writing & Preference

- Gemini 2.5 Pro: 63.9 (#60)
- Mistral Medium 3.5: 58.6 (#113)

| Benchmark | Gemini 2.5 Pro | Mistral Medium 3.5 |
|---|---|---|
| LMArena Text | 1458 | 1421 |
| LMArena Creative Writing | 1453 | 1372 |
| LMArena Multi-Turn | 1453 | 1423 |
| Short-Story Creative Writing | 83.8% | — |
| EQ-Bench Creative Writing | 1421 | — |
| WildBench | 85.7% | — |
| EQ-Bench 4 | — | 993 |
| LiveBench Language | 67.8% | — |

## FAQ

### Is Gemini 2.5 Pro better than Mistral Medium 3.5?

Gemini 2.5 Pro is the stronger model overall, scoring 44.9 to 39.6 on the Noometry Index.

### Which is cheaper, Gemini 2.5 Pro or Mistral Medium 3.5?

Mistral Medium 3.5 is cheaper. It lists at $1.50 per million input tokens and $7.50 per million output tokens; Gemini 2.5 Pro lists at $1.25 and $10.

### Is Gemini 2.5 Pro or Mistral Medium 3.5 better for coding?

Gemini 2.5 Pro scores higher on coding benchmarks: 42.8 versus 35.7 in the Noometry coding category.

### Which has the bigger context window?

Gemini 2.5 Pro does, with 1.05M tokens against 262K.

### How many benchmarks do Gemini 2.5 Pro and Mistral Medium 3.5 share?

20 benchmarks have published results for both models. Gemini 2.5 Pro has 78 scored results on Noometry and Mistral Medium 3.5 has 22.