Noometry

Model comparison

Gemini 2.0 Flash-Lite vs Mistral Medium 3.5

Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 37.8 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemini 2.0 Flash-Lite Google

37.8

Rank #194 Confirmed

Mistral Medium 3.5 Mistral AI

40.2

Rank #152 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemini 2.0 Flash-Lite scores higher in 2 categories and Mistral Medium 3.5 in 7 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in multimodal, where Mistral Medium 3.5 leads 38.3 to 31.2.
  • Mistral Medium 3.5 has downloadable open weights; the other is API-only.

Side by side

Gemini 2.0 Flash-LiteMistral Medium 3.5
ProviderGoogleMistral AI
Noometry Index37.840.2
Released2025-02-05—
WeightsProprietaryOpen
Context window—262K
Max output—210K
Input $ / M tokens—$1.50
Output $ / M tokens—$7.50
Results tracked3222

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.0 Flash-Lite leads

Gemini 2.0 Flash-Lite: 37.9 (#185), Mistral Medium 3.5: 36.0 (#213)

BenchmarkGemini 2.0 Flash-LiteMistral Medium 3.5
LMArena Coding13221461
LMArena WebDev—1264
LiveBench Coding47.1%—

Reasoning Gemini 2.0 Flash-Lite leads

Gemini 2.0 Flash-Lite: 22.0 (#210), Mistral Medium 3.5: 17.3 (#295)

BenchmarkGemini 2.0 Flash-LiteMistral Medium 3.5
LMArena Hard Prompts13241436
Kagi LLM Benchmark—41.4%
NYT Connections (extended)—12.9%
LiveBench Reasoning50.1%—
DTBench52.5%—
LiveBench Data Analysis65.5%—
Epoch Capabilities Index—141.35
ForecastBench57.1—
LiveBench54.3%—

Math Mistral Medium 3.5 leads

Gemini 2.0 Flash-Lite: 34.1 (#196), Mistral Medium 3.5: 39.1 (#113)

BenchmarkGemini 2.0 Flash-LiteMistral Medium 3.5
LMArena Math13091431
Omni-MATH37.4%—
LiveBench Math58.1%—

Knowledge Mistral Medium 3.5 leads

Gemini 2.0 Flash-Lite: 35.0 (#189), Mistral Medium 3.5: 40.0 (#126)

BenchmarkGemini 2.0 Flash-LiteMistral Medium 3.5
LMArena Expert13051432
MMLU-Pro72%—
GPQA (HELM)50%—

Multimodal Mistral Medium 3.5 leads

Gemini 2.0 Flash-Lite: 31.2 (#109), Mistral Medium 3.5: 38.3 (#65)

BenchmarkGemini 2.0 Flash-LiteMistral Medium 3.5
LMArena Vision11001223

Multilingual Mistral Medium 3.5 leads

Gemini 2.0 Flash-Lite: 46.0 (#161), Mistral Medium 3.5: 51.9 (#100)

BenchmarkGemini 2.0 Flash-LiteMistral Medium 3.5
LMArena Non-English13231404
LMArena Chinese13391442
LMArena French13471448
LMArena German13061451
LMArena Korean13251385
LMArena Russian13281395
LMArena Spanish13131409
LMArena Japanese1301—

Instruction Following Mistral Medium 3.5 leads

Gemini 2.0 Flash-Lite: 70.4 (#163), Mistral Medium 3.5: 74.6 (#90)

BenchmarkGemini 2.0 Flash-LiteMistral Medium 3.5
LMArena Instruction Following13051415
LiveBench Instruction Following78.3%—
IFEval82.4%—

Long Context Mistral Medium 3.5 leads

Gemini 2.0 Flash-Lite: 40.1 (#160), Mistral Medium 3.5: 43.2 (#103)

BenchmarkGemini 2.0 Flash-LiteMistral Medium 3.5
LMArena Longer Query13201415

Writing & Preference Mistral Medium 3.5 leads

Gemini 2.0 Flash-Lite: 51.7 (#177), Mistral Medium 3.5: 58.5 (#117)

BenchmarkGemini 2.0 Flash-LiteMistral Medium 3.5
LMArena Text13301421
LMArena Creative Writing13191374
LMArena Multi-Turn13071423
WildBench79%—
EQ-Bench 4—993
LiveBench Language34.3%—

Frequently asked questions

Is Gemini 2.0 Flash-Lite better than Mistral Medium 3.5?

Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 37.8 on the Noometry Index.

Is Gemini 2.0 Flash-Lite or Mistral Medium 3.5 better for coding?

Gemini 2.0 Flash-Lite scores higher on coding benchmarks: 37.9 versus 36.0 in the Noometry coding category.

How many benchmarks do Gemini 2.0 Flash-Lite and Mistral Medium 3.5 share?

17 benchmarks have published results for both models. Gemini 2.0 Flash-Lite has 32 scored results on Noometry and Mistral Medium 3.5 has 22.

Related comparisons

Go deeper