Noometry

Model comparison

Gemini 2.5 Flash vs Mistral

Gemini 2.5 Flash is the stronger model overall, scoring 39.3 to 29.9 on the Noometry Index.

Last verified . 22 shared benchmarks.

Gemini 2.5 Flash Google

39.3

Rank #170 Confirmed

Mistral Mistral AI

29.9

Rank #303 Confirmed

Summary

  • They share 22 benchmarks with published results for both. Gemini 2.5 Flash scores higher in 7 categories and Mistral in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in instruction following, where Gemini 2.5 Flash leads 75.7 to 52.6.
  • The biggest single-benchmark swing is MMLU-Pro: 63.9% for Gemini 2.5 Flash and 27.7% for Mistral.

Side by side

Gemini 2.5 FlashMistral
ProviderGoogleMistral AI
Noometry Index39.329.9
Released2025-04-17—
WeightsProprietaryProprietary
Context window1.05M—
Max output66K—
Input $ / M tokens$0.30—
Output $ / M tokens$2.50—
Results tracked5422

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.5 Flash leads

Gemini 2.5 Flash: 35.8 (#220), Mistral: 33.8 (#250)

BenchmarkGemini 2.5 FlashMistral
LMArena Coding14241162
SWE-bench Verified (bash only)28.7%—
Aider Polyglot55.1%—
WeirdML41.9%—
ALE-Bench661.88—

Agentic & Tool Use Not comparable

Gemini 2.5 Flash: 30.8 (#74), Mistral: —

BenchmarkGemini 2.5 FlashMistral
Terminal-Bench17.1%—
Berkeley Function Calling Leaderboard56.2%—
TheAgentCompany41.1%—
BALROG33.5%—
Vending-Bench 2548.84—

Reasoning Mistral leads

Gemini 2.5 Flash: 18.1 (#286), Mistral: 22.2 (#200)

BenchmarkGemini 2.5 FlashMistral
LMArena Hard Prompts14221149
ARC-AGI-22.5%—
SimpleBench41.2%—
Kagi LLM Benchmark56.8%—
ARC-AGI-133.3%—
CritPt1.1%—
EnigmaEval2.7%—
DTBench76.5%—
LMCA27.5%—
Epoch Capabilities Index143.03—
ForecastBench60.6—

Math Gemini 2.5 Flash leads

Gemini 2.5 Flash: 39.9 (#98), Mistral: 22.3 (#278)

BenchmarkGemini 2.5 FlashMistral
Omni-MATH38.5%7.2%
LMArena Math14151180
OTIS Mock AIME 2024-202573.1%—
FrontierMath (Feb 2025 set)4.8%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Gemini 2.5 Flash leads

Gemini 2.5 Flash: 36.4 (#168), Mistral: 16.6 (#288)

BenchmarkGemini 2.5 FlashMistral
MMLU-Pro63.9%27.7%
GPQA (HELM)39%30.3%
LMArena Expert14261125
Humanity's Last Exam12.1%—
Confabulations16.8%—
Vectara Hallucination Rate7.8%—

Multimodal Not comparable

Gemini 2.5 Flash: 41.8 (#32), Mistral: —

BenchmarkGemini 2.5 FlashMistral
LMArena Vision1253—
GeoBench76%—
VPCT46.2%—
SpatialViz-Bench36.9%—

Multilingual Gemini 2.5 Flash leads

Gemini 2.5 Flash: 52.3 (#88), Mistral: 32.8 (#254)

BenchmarkGemini 2.5 FlashMistral
LMArena Non-English14091129
LMArena Chinese14501109
LMArena French14331180
LMArena German14181155
LMArena Japanese14051013
LMArena Korean13851032
LMArena Russian14151168
LMArena Spanish14211143

Instruction Following Gemini 2.5 Flash leads

Gemini 2.5 Flash: 75.7 (#54), Mistral: 52.6 (#288)

BenchmarkGemini 2.5 FlashMistral
IFEval89.8%56.8%
LMArena Instruction Following14051152

Long Context Gemini 2.5 Flash leads

Gemini 2.5 Flash: 47.5 (#17), Mistral: 35.0 (#245)

BenchmarkGemini 2.5 FlashMistral
LMArena Longer Query14191153
Fiction.LiveBench77.8%—

Writing & Preference Gemini 2.5 Flash leads

Gemini 2.5 Flash: 53.8 (#157), Mistral: 37.0 (#260)

BenchmarkGemini 2.5 FlashMistral
LMArena Text14171165
LMArena Creative Writing14001158
WildBench81.7%66%
LMArena Multi-Turn14081147
Short-Story Creative Writing76.5%—
EQ-Bench Creative Writing1137—

Frequently asked questions

Is Gemini 2.5 Flash better than Mistral?

Gemini 2.5 Flash is the stronger model overall, scoring 39.3 to 29.9 on the Noometry Index.

Is Gemini 2.5 Flash or Mistral better for coding?

Gemini 2.5 Flash scores higher on coding benchmarks: 35.8 versus 33.8 in the Noometry coding category.

How many benchmarks do Gemini 2.5 Flash and Mistral share?

22 benchmarks have published results for both models. Gemini 2.5 Flash has 54 scored results on Noometry and Mistral has 22.

Related comparisons

Go deeper