Noometry

Model comparison

Gemini Advanced 0514 vs Mistral Small 3.1

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 31.7 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemini Advanced 0514 Google

37.7

Rank #197 Confirmed

Mistral Small 3.1 Mistral AI

31.7

Rank #269 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemini Advanced 0514 scores higher in 6 categories and Mistral Small 3.1 in 2 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini Advanced 0514 leads 35.5 to 14.7.
  • Mistral Small 3.1 has downloadable open weights; the other is API-only.

Side by side

Gemini Advanced 0514Mistral Small 3.1
ProviderGoogleMistral AI
Noometry Index37.731.7
Released—2025-03-17
WeightsProprietaryOpen
Context window—128K
Max output—102K
Input $ / M tokens—$0.35
Output $ / M tokens—$0.56
Results tracked1728

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Small 3.1 leads

Gemini Advanced 0514: 36.6 (#205), Mistral Small 3.1: 38.3 (#179)

BenchmarkGemini Advanced 0514Mistral Small 3.1
LMArena Coding12551309

Reasoning Gemini Advanced 0514 leads

Gemini Advanced 0514: 24.6 (#160), Mistral Small 3.1: 19.7 (#254)

BenchmarkGemini Advanced 0514Mistral Small 3.1
LMArena Hard Prompts12481278
Chess Puzzles—1%
Epoch Capabilities Index—127.48

Math Gemini Advanced 0514 leads

Gemini Advanced 0514: 35.5 (#181), Mistral Small 3.1: 14.7 (#301)

BenchmarkGemini Advanced 0514Mistral Small 3.1
LMArena Math12721262
OTIS Mock AIME 2024-2025—3.9%
Omni-MATH—24.8%

Knowledge Gemini Advanced 0514 leads

Gemini Advanced 0514: 33.3 (#205), Mistral Small 3.1: 22.6 (#271)

BenchmarkGemini Advanced 0514Mistral Small 3.1
LMArena Expert12151257
GPQA Diamond—41.9%
MMLU-Pro—61%
GPQA (HELM)—39.2%

Multimodal Not comparable

Gemini Advanced 0514: —, Mistral Small 3.1: 33.2 (#99)

BenchmarkGemini Advanced 0514Mistral Small 3.1
LMArena Vision—1136

Multilingual Gemini Advanced 0514 leads

Gemini Advanced 0514: 42.6 (#192), Mistral Small 3.1: 41.2 (#209)

BenchmarkGemini Advanced 0514Mistral Small 3.1
LMArena Non-English12741255
LMArena Chinese12741253
LMArena French13071273
LMArena German12751266
LMArena Japanese12421208
LMArena Korean12321206
LMArena Russian12831263
LMArena Spanish12421283

Instruction Following Gemini Advanced 0514 leads

Gemini Advanced 0514: 66.0 (#212), Mistral Small 3.1: 63.6 (#230)

BenchmarkGemini Advanced 0514Mistral Small 3.1
LMArena Instruction Following12531264
IFEval—75%

Long Context Mistral Small 3.1 leads

Gemini Advanced 0514: 38.0 (#207), Mistral Small 3.1: 39.5 (#178)

BenchmarkGemini Advanced 0514Mistral Small 3.1
LMArena Longer Query12531299

Writing & Preference Gemini Advanced 0514 leads

Gemini Advanced 0514: 48.5 (#200), Mistral Small 3.1: 37.0 (#259)

BenchmarkGemini Advanced 0514Mistral Small 3.1
LMArena Text12791277
LMArena Creative Writing12841253
LMArena Multi-Turn12691270
EQ-Bench Creative Writing—761
WildBench—78.8%

Frequently asked questions

Is Gemini Advanced 0514 better than Mistral Small 3.1?

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 31.7 on the Noometry Index.

Is Gemini Advanced 0514 or Mistral Small 3.1 better for coding?

Mistral Small 3.1 scores higher on coding benchmarks: 38.3 versus 36.6 in the Noometry coding category.

How many benchmarks do Gemini Advanced 0514 and Mistral Small 3.1 share?

17 benchmarks have published results for both models. Gemini Advanced 0514 has 17 scored results on Noometry and Mistral Small 3.1 has 28.

Related comparisons

Go deeper