Noometry

Model comparison

Gemini 2.5 Flash-Lite vs Mixtral 8x22B

Gemini 2.5 Flash-Lite is the stronger model overall, scoring 36.4 to 26.7 on the Noometry Index.

Last verified . 25 shared benchmarks.

Gemini 2.5 Flash-Lite Google

36.4

Rank #208 Confirmed

Mixtral 8x22B Mistral AI

26.7

Rank #330 Confirmed

Summary

  • They share 25 benchmarks with published results for both. Gemini 2.5 Flash-Lite scores higher in 8 categories and Mixtral 8x22B in 1 category; 9 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemini 2.5 Flash-Lite leads 57.0 to 37.1.
  • The biggest single-benchmark swing is WeirdML: 35.2% for Gemini 2.5 Flash-Lite and 3.2% for Mixtral 8x22B.
  • Gemini 2.5 Flash-Lite is cheaper at $0.10 / $0.40 per million input/output tokens, against $2 / $6 for Mixtral 8x22B.
  • Gemini 2.5 Flash-Lite accepts more context: 1.05M tokens versus 64K.
  • Mixtral 8x22B has downloadable open weights; the other is API-only.

Side by side

Gemini 2.5 Flash-LiteMixtral 8x22B
ProviderGoogleMistral AI
Noometry Index36.426.7
Released2025-06-172024-04-17
WeightsProprietaryOpen
Context window1.05M64K
Max output66K64K
Input $ / M tokens$0.10$2
Output $ / M tokens$0.40$6
Results tracked3334

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 38.0 (#167), Mixtral 8x22B: 23.8 (#324)

BenchmarkGemini 2.5 Flash-LiteMixtral 8x22B
WeirdML35.2%3.2%
LMArena Coding13731166
BigCodeBench Instruct—40.6%
BigCodeBench Complete—50.2%
ALE-Bench325.9—
HumanEval+—72%
MBPP+—64.3%

Agentic & Tool Use Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 27.8 (#89), Mixtral 8x22B: 22.8 (#119)

BenchmarkGemini 2.5 Flash-LiteMixtral 8x22B
Berkeley Function Calling Leaderboard36.9%—
Cybench—7.5%

Reasoning Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 21.5 (#196), Mixtral 8x22B: 19.1 (#246)

BenchmarkGemini 2.5 Flash-LiteMixtral 8x22B
LMArena Hard Prompts13771150
DTBench62.8%55.1%
Epoch Capabilities Index133.93122
Kagi LLM Benchmark40.5%—
LMCA18.1%—
ForecastBench—56.3

Math Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 35.5 (#144), Mixtral 8x22B: 21.2 (#271)

BenchmarkGemini 2.5 Flash-LiteMixtral 8x22B
Omni-MATH48%16.3%
LMArena Math13731184
MATH Level 5—24.2%

Knowledge Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 32.1 (#206), Mixtral 8x22B: 15.1 (#288)

BenchmarkGemini 2.5 Flash-LiteMixtral 8x22B
MMLU-Pro53.7%46%
GPQA (HELM)30.9%33.4%
LMArena Expert13731113
GPQA Diamond—34.1%
Vectara Hallucination Rate3.3%—
MMLU—77.8%

Multimodal Not comparable

Gemini 2.5 Flash-Lite: 28.6 (#109), Mixtral 8x22B: —

BenchmarkGemini 2.5 Flash-LiteMixtral 8x22B
LMArena Vision1198—
VPCT30%—

Multilingual Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 49.5 (#129), Mixtral 8x22B: 32.9 (#250)

BenchmarkGemini 2.5 Flash-LiteMixtral 8x22B
LMArena Non-English13691128
LMArena Chinese14041116
LMArena French13881165
LMArena German13901141
LMArena Japanese13591037
LMArena Korean13581056
LMArena Russian13731158
LMArena Spanish13961150

Instruction Following Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 70.2 (#163), Mixtral 8x22B: 57.9 (#261)

BenchmarkGemini 2.5 Flash-LiteMixtral 8x22B
IFEval81%72.4%
LMArena Instruction Following13661147

Long Context Mixtral 8x22B leads

Gemini 2.5 Flash-Lite: 33.3 (#257), Mixtral 8x22B: 34.6 (#242)

BenchmarkGemini 2.5 Flash-LiteMixtral 8x22B
LMArena Longer Query13731144
Fiction.LiveBench47.2%—

Writing & Preference Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 57.0 (#130), Mixtral 8x22B: 37.1 (#257)

BenchmarkGemini 2.5 Flash-LiteMixtral 8x22B
LMArena Text13791162
LMArena Creative Writing13661141
WildBench81.8%71.1%
LMArena Multi-Turn13671130

Frequently asked questions

Is Gemini 2.5 Flash-Lite better than Mixtral 8x22B?

Gemini 2.5 Flash-Lite is the stronger model overall, scoring 36.4 to 26.7 on the Noometry Index.

Which is cheaper, Gemini 2.5 Flash-Lite or Mixtral 8x22B?

Gemini 2.5 Flash-Lite is cheaper. It lists at $0.10 per million input tokens and $0.40 per million output tokens; Mixtral 8x22B lists at $2 and $6.

Is Gemini 2.5 Flash-Lite or Mixtral 8x22B better for coding?

Gemini 2.5 Flash-Lite scores higher on coding benchmarks: 38.0 versus 23.8 in the Noometry coding category.

Which has the bigger context window?

Gemini 2.5 Flash-Lite does, with 1.05M tokens against 64K.

How many benchmarks do Gemini 2.5 Flash-Lite and Mixtral 8x22B share?

25 benchmarks have published results for both models. Gemini 2.5 Flash-Lite has 33 scored results on Noometry and Mixtral 8x22B has 34.

Related comparisons

Go deeper