Model comparison

Gemini 2.0 Flash (Feb 2025) vs Mistral Small 3.2

Gemini 2.0 Flash (Feb 2025) is the stronger model overall, scoring 35.1 to 31.2 on the Noometry Index.

Last verified . 5 shared benchmarks.

Gemini 2.0 Flash (Feb 2025) Google

35.1

Rank #228 Confirmed

Mistral Small 3.2 Mistral AI

31.2

Rank #280 Confirmed

Summary

  • They share 5 benchmarks with published results for both. Gemini 2.0 Flash (Feb 2025) scores higher in 3 categories and Mistral Small 3.2 in 1 category; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 2.0 Flash (Feb 2025) leads 37.9 to 26.3.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 57.8% for Gemini 2.0 Flash (Feb 2025) and 30.3% for Mistral Small 3.2.
  • Mistral Small 3.2 has downloadable open weights; the other is API-only.

Side by side

Gemini 2.0 Flash (Feb 2025) and Mistral Small 3.2 specifications
Gemini 2.0 Flash (Feb 2025)Mistral Small 3.2
ProviderGoogleMistral AI
Noometry Index35.131.2
Released2024-12-062025-06-20
WeightsProprietaryOpen
Context window—256K
Max output—16K
Input $ / M tokens—$0.0938
Output $ / M tokens—$0.25
Results tracked546

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemini 2.0 Flash (Feb 2025): 28.4 (#315), Mistral Small 3.2: —

Coding benchmarks
BenchmarkGemini 2.0 Flash (Feb 2025)Mistral Small 3.2
SWE-bench Verified (bash only)13.5%—
Aider Polyglot38.2%—
WeirdML25.8%—
BigCodeBench Instruct45.9%—
LiveBench Coding63.4%—
LMArena Coding1350—
BigCodeBench Complete59.9%—
CadEval30%—

Agentic & Tool Use Not comparable

Gemini 2.0 Flash (Feb 2025): 28.1 (#92), Mistral Small 3.2: —

Agentic & Tool Use benchmarks
BenchmarkGemini 2.0 Flash (Feb 2025)Mistral Small 3.2
TheAgentCompany11.4%—

Reasoning Mistral Small 3.2 leads

Gemini 2.0 Flash (Feb 2025): 15.2 (#318), Mistral Small 3.2: 18.1 (#287)

Reasoning benchmarks
BenchmarkGemini 2.0 Flash (Feb 2025)Mistral Small 3.2
Kagi LLM Benchmark37.8%40.4%
Epoch Capabilities Index135.36131.74
ARC-AGI-21.3%—
SimpleBench31.1%—
Chess Puzzles—1%
EnigmaEval1.1%—
LiveBench Reasoning78.2%—
LMArena Hard Prompts1346—
DTBench63.2%—
LiveBench Data Analysis69.4%—
LiveBench66.9%—

Math Gemini 2.0 Flash (Feb 2025) leads

Gemini 2.0 Flash (Feb 2025): 37.9 (#146), Mistral Small 3.2: 26.3 (#260)

Math benchmarks
BenchmarkGemini 2.0 Flash (Feb 2025)Mistral Small 3.2
OTIS Mock AIME 2024-202557.8%30.3%
Omni-MATH45.9%—
LiveBench Math75.8%—
LMArena Math1352—
MATH Level 582.2%—
FrontierMath (Feb 2025 set)1.7%—

Knowledge Gemini 2.0 Flash (Feb 2025) leads

Gemini 2.0 Flash (Feb 2025): 32.0 (#213), Mistral Small 3.2: 26.7 (#256)

Knowledge benchmarks
BenchmarkGemini 2.0 Flash (Feb 2025)Mistral Small 3.2
GPQA Diamond64.1%49.1%
Humanity's Last Exam6.6%—
MMLU-Pro73.7%—
Confabulations12.4%—
GPQA (HELM)55.6%—
LMArena Expert1339—
MMLU79.7%—

Multimodal Not comparable

Gemini 2.0 Flash (Feb 2025): 36.5 (#79), Mistral Small 3.2: —

Multimodal benchmarks
BenchmarkGemini 2.0 Flash (Feb 2025)Mistral Small 3.2
LMArena Vision1158—
GeoBench77%—

Multilingual Not comparable

Gemini 2.0 Flash (Feb 2025): 47.4 (#149), Mistral Small 3.2: —

Multilingual benchmarks
BenchmarkGemini 2.0 Flash (Feb 2025)Mistral Small 3.2
LMArena Non-English1342—
LMArena Chinese1373—
LMArena French1391—
LMArena German1353—
LMArena Japanese1294—
LMArena Korean1313—
LMArena Russian1351—
LMArena Spanish1363—

Instruction Following Not comparable

Gemini 2.0 Flash (Feb 2025): 74.4 (#97), Mistral Small 3.2: —

Instruction Following benchmarks
BenchmarkGemini 2.0 Flash (Feb 2025)Mistral Small 3.2
LiveBench Instruction Following85.8%—
IFEval84.1%—
LMArena Instruction Following1336—

Long Context Not comparable

Gemini 2.0 Flash (Feb 2025): 38.1 (#203), Mistral Small 3.2: —

Long Context benchmarks
BenchmarkGemini 2.0 Flash (Feb 2025)Mistral Small 3.2
Fiction.LiveBench61.1%—
LMArena Longer Query1344—

Writing & Preference Gemini 2.0 Flash (Feb 2025) leads

Gemini 2.0 Flash (Feb 2025): 49.5 (#190), Mistral Small 3.2: 45.0 (#224)

Writing & Preference benchmarks
BenchmarkGemini 2.0 Flash (Feb 2025)Mistral Small 3.2
EQ-Bench Creative Writing11281255
LMArena Text1354—
LMArena Creative Writing1340—
Short-Story Creative Writing73.8%—
WildBench80%—
LMArena Multi-Turn1350—
LiveBench Language51.3%—

Frequently asked questions

Is Gemini 2.0 Flash (Feb 2025) better than Mistral Small 3.2?

Gemini 2.0 Flash (Feb 2025) is the stronger model overall, scoring 35.1 to 31.2 on the Noometry Index.

How many benchmarks do Gemini 2.0 Flash (Feb 2025) and Mistral Small 3.2 share?

5 benchmarks have published results for both models. Gemini 2.0 Flash (Feb 2025) has 54 scored results on Noometry and Mistral Small 3.2 has 6.

Related comparisons

Go deeper