Noometry

Model comparison

Gemini 2.0 Flash-Lite vs Mistral Small

Gemini 2.0 Flash-Lite is the stronger model overall, scoring 37.8 to 33.4 on the Noometry Index.

Last verified . 26 shared benchmarks.

Gemini 2.0 Flash-Lite Google

37.8

Rank #194 Confirmed

Mistral Small Mistral AI

33.4

Rank #243 Confirmed

Summary

  • They share 26 benchmarks with published results for both. Gemini 2.0 Flash-Lite scores higher in 6 categories and Mistral Small in 3 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 2.0 Flash-Lite leads 34.1 to 16.4.
  • The biggest single-benchmark swing is DTBench: 52.5% for Gemini 2.0 Flash-Lite and 70.9% for Mistral Small.
  • Mistral Small has downloadable open weights; the other is API-only.

Side by side

Gemini 2.0 Flash-LiteMistral Small
ProviderGoogleMistral AI
Noometry Index37.833.4
Released2025-02-052024-02-26
WeightsProprietaryOpen
Context window—262K
Max output—256K
Input $ / M tokens—$0.15
Output $ / M tokens—$0.60
Results tracked3239

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.0 Flash-Lite leads

Gemini 2.0 Flash-Lite: 37.9 (#185), Mistral Small: 34.0 (#247)

BenchmarkGemini 2.0 Flash-LiteMistral Small
LiveBench Coding47.1%36.2%
LMArena Coding13221362
SciCode—26.5%
BigCodeBench Instruct—36.1%
BigCodeBench Complete—46.6%
ALE-Bench—497.62

Agentic & Tool Use Not comparable

Gemini 2.0 Flash-Lite: —, Mistral Small: 28.1 (#93)

BenchmarkGemini 2.0 Flash-LiteMistral Small
Berkeley Function Calling Leaderboard—37.1%

Reasoning Gemini 2.0 Flash-Lite leads

Gemini 2.0 Flash-Lite: 22.0 (#210), Mistral Small: 19.8 (#250)

BenchmarkGemini 2.0 Flash-LiteMistral Small
LiveBench Reasoning50.1%44.8%
LMArena Hard Prompts13241335
DTBench52.5%70.9%
LiveBench Data Analysis65.5%53.7%
LiveBench54.3%44%
Kagi LLM Benchmark—37.8%
CritPt—0%
LMCA—20.6%
ForecastBench57.1—

Math Gemini 2.0 Flash-Lite leads

Gemini 2.0 Flash-Lite: 34.1 (#196), Mistral Small: 16.4 (#293)

BenchmarkGemini 2.0 Flash-LiteMistral Small
LiveBench Math58.1%39.9%
LMArena Math13091341
OTIS Mock AIME 2024-2025—5.8%
Omni-MATH37.4%—
MATH Level 5—46.8%

Knowledge Gemini 2.0 Flash-Lite leads

Gemini 2.0 Flash-Lite: 35.0 (#189), Mistral Small: 31.0 (#222)

BenchmarkGemini 2.0 Flash-LiteMistral Small
LMArena Expert13051291
GPQA Diamond—47.5%
MMLU-Pro72%—
Vectara Hallucination Rate—5.1%
GPQA (HELM)50%—
MMLU—68.7%

Multimodal Mistral Small leads

Gemini 2.0 Flash-Lite: 31.2 (#109), Mistral Small: 33.5 (#96)

BenchmarkGemini 2.0 Flash-LiteMistral Small
LMArena Vision11001142

Multilingual Too close to call

Gemini 2.0 Flash-Lite: 46.0 (#161), Mistral Small: 45.5 (#169)

BenchmarkGemini 2.0 Flash-LiteMistral Small
LMArena Non-English13231315
LMArena Chinese13391340
LMArena French13471337
LMArena German13061340
LMArena Japanese13011275
LMArena Korean13251259
LMArena Russian13281324
LMArena Spanish13131346

Instruction Following Gemini 2.0 Flash-Lite leads

Gemini 2.0 Flash-Lite: 70.4 (#163), Mistral Small: 66.4 (#209)

BenchmarkGemini 2.0 Flash-LiteMistral Small
LiveBench Instruction Following78.3%63.7%
LMArena Instruction Following13051310
IFEval82.4%—

Long Context Too close to call

Gemini 2.0 Flash-Lite: 40.1 (#160), Mistral Small: 40.4 (#156)

BenchmarkGemini 2.0 Flash-LiteMistral Small
LMArena Longer Query13201327

Writing & Preference Too close to call

Gemini 2.0 Flash-Lite: 51.7 (#177), Mistral Small: 52.5 (#171)

BenchmarkGemini 2.0 Flash-LiteMistral Small
LMArena Text13301338
LMArena Creative Writing13191305
LMArena Multi-Turn13071344
LiveBench Language34.3%30.5%
WildBench79%—

Frequently asked questions

Is Gemini 2.0 Flash-Lite better than Mistral Small?

Gemini 2.0 Flash-Lite is the stronger model overall, scoring 37.8 to 33.4 on the Noometry Index.

Is Gemini 2.0 Flash-Lite or Mistral Small better for coding?

Gemini 2.0 Flash-Lite scores higher on coding benchmarks: 37.9 versus 34.0 in the Noometry coding category.

How many benchmarks do Gemini 2.0 Flash-Lite and Mistral Small share?

26 benchmarks have published results for both models. Gemini 2.0 Flash-Lite has 32 scored results on Noometry and Mistral Small has 39.

Related comparisons

Go deeper