Noometry

Model comparison

Gemini 2.5 Flash-Lite vs Qwen2.5 72B Instruct

Gemini 2.5 Flash-Lite is the stronger model overall, scoring 37.0 to 31.9 on the Noometry Index.

Last verified . 26 shared benchmarks.

Gemini 2.5 Flash-Lite Google

37.0

Rank #211 Confirmed

Qwen2.5 72B Instruct Alibaba (Qwen)

31.9

Rank #267 Confirmed

Summary

  • They share 26 benchmarks with published results for both. Gemini 2.5 Flash-Lite scores higher in 7 categories and Qwen2.5 72B Instruct in 2 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 2.5 Flash-Lite leads 38.0 to 19.3.
  • The biggest single-benchmark swing is WeirdML: 35.2% for Gemini 2.5 Flash-Lite and 16% for Qwen2.5 72B Instruct.
  • Gemini 2.5 Flash-Lite is cheaper at $0.10 / $0.40 per million input/output tokens, against $1.40 / $5.60 for Qwen2.5 72B Instruct.
  • Gemini 2.5 Flash-Lite accepts more context: 1.05M tokens versus 131K.
  • Qwen2.5 72B Instruct has downloadable open weights; the other is API-only.

Side by side

Gemini 2.5 Flash-LiteQwen2.5 72B Instruct
ProviderGoogleAlibaba (Qwen)
Noometry Index37.031.9
Released2025-06-172024-09
WeightsProprietaryOpen
Context window1.05M131K
Max output66K8K
Input $ / M tokens$0.10$1.40
Output $ / M tokens$0.40$5.60
Results tracked3343

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 38.5 (#173), Qwen2.5 72B Instruct: 33.2 (#260)

BenchmarkGemini 2.5 Flash-LiteQwen2.5 72B Instruct
WeirdML35.2%16%
LMArena Coding13731292
BigCodeBench Instruct—45.8%
BigCodeBench Complete—55.9%
ALE-Bench325.9—

Agentic & Tool Use Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 28.0 (#96), Qwen2.5 72B Instruct: 22.1 (#133)

BenchmarkGemini 2.5 Flash-LiteQwen2.5 72B Instruct
Berkeley Function Calling Leaderboard36.9%—
TheAgentCompany—5.7%
BALROG—16.2%
METR Time Horizons—35.8%

Reasoning Too close to call

Gemini 2.5 Flash-Lite: 22.2 (#205), Qwen2.5 72B Instruct: 22.3 (#199)

BenchmarkGemini 2.5 Flash-LiteQwen2.5 72B Instruct
LMArena Hard Prompts13771271
DTBench62.8%62.9%
LMCA18.1%13.4%
Epoch Capabilities Index133.94129
Kagi LLM Benchmark40.5%—
BIG-Bench Hard—79.8%
ForecastBench—57.5
HellaSwag—84.8%
PIQA—82.6%
WinoGrande—82.3%

Math Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 38.0 (#144), Qwen2.5 72B Instruct: 19.3 (#287)

BenchmarkGemini 2.5 Flash-LiteQwen2.5 72B Instruct
Omni-MATH48%33%
LMArena Math13731283
OTIS Mock AIME 2024-2025—8.1%
MATH Level 5—63.2%

Knowledge Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 32.5 (#210), Qwen2.5 72B Instruct: 27.0 (#253)

BenchmarkGemini 2.5 Flash-LiteQwen2.5 72B Instruct
MMLU-Pro53.7%63.1%
GPQA (HELM)30.9%42.6%
LMArena Expert13731245
GPQA Diamond—49.1%
Confabulations—19.1%
Vectara Hallucination Rate3.3%—
ARC (AI2) Challenge—94.5%
MMLU—85.3%
TriviaQA—71.9%

Multimodal Not comparable

Gemini 2.5 Flash-Lite: 29.1 (#114), Qwen2.5 72B Instruct: —

BenchmarkGemini 2.5 Flash-LiteQwen2.5 72B Instruct
LMArena Vision1198—
VPCT30%—

Multilingual Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 49.3 (#134), Qwen2.5 72B Instruct: 41.0 (#213)

BenchmarkGemini 2.5 Flash-LiteQwen2.5 72B Instruct
LMArena Non-English13691252
LMArena Chinese14041272
LMArena French13881280
LMArena German13891234
LMArena Japanese13591180
LMArena Korean13601188
LMArena Russian13731264
LMArena Spanish13961256

Instruction Following Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 70.0 (#168), Qwen2.5 72B Instruct: 65.5 (#221)

BenchmarkGemini 2.5 Flash-LiteQwen2.5 72B Instruct
IFEval81%80.6%
LMArena Instruction Following13671254

Long Context Qwen2.5 72B Instruct leads

Gemini 2.5 Flash-Lite: 33.3 (#262), Qwen2.5 72B Instruct: 38.9 (#188)

BenchmarkGemini 2.5 Flash-LiteQwen2.5 72B Instruct
LMArena Longer Query13731282
Fiction.LiveBench47.2%—

Writing & Preference Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 56.8 (#135), Qwen2.5 72B Instruct: 46.7 (#215)

BenchmarkGemini 2.5 Flash-LiteQwen2.5 72B Instruct
LMArena Text13791269
LMArena Creative Writing13671221
WildBench81.8%80.2%
LMArena Multi-Turn13661272

Frequently asked questions

Is Gemini 2.5 Flash-Lite better than Qwen2.5 72B Instruct?

Gemini 2.5 Flash-Lite is the stronger model overall, scoring 37.0 to 31.9 on the Noometry Index.

Which is cheaper, Gemini 2.5 Flash-Lite or Qwen2.5 72B Instruct?

Gemini 2.5 Flash-Lite is cheaper. It lists at $0.10 per million input tokens and $0.40 per million output tokens; Qwen2.5 72B Instruct lists at $1.40 and $5.60.

Is Gemini 2.5 Flash-Lite or Qwen2.5 72B Instruct better for coding?

Gemini 2.5 Flash-Lite scores higher on coding benchmarks: 38.5 versus 33.2 in the Noometry coding category.

Which has the bigger context window?

Gemini 2.5 Flash-Lite does, with 1.05M tokens against 131K.

How many benchmarks do Gemini 2.5 Flash-Lite and Qwen2.5 72B Instruct share?

26 benchmarks have published results for both models. Gemini 2.5 Flash-Lite has 33 scored results on Noometry and Qwen2.5 72B Instruct has 43.

Related comparisons

Go deeper