Model comparison

Gemini 3.1 Flash Lite vs Qwen2.5 7B Instruct

Gemini 3.1 Flash Lite is the stronger model overall, scoring 40.8 to 29.0 on the Noometry Index. Qwen2.5 7B Instruct costs 1.8× less per token, which makes it the better buy when Gemini 3.1 Flash Lite's lead doesn't matter for your workload.

Last verified . 6 shared benchmarks.

Gemini 3.1 Flash Lite Google

40.8

Rank #144 Confirmed

Qwen2.5 7B Instruct Alibaba (Qwen)

29.0

Rank #320 Confirmed

Summary

  • They share 6 benchmarks with published results for both. Gemini 3.1 Flash Lite scores higher in 7 categories and Qwen2.5 7B Instruct in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 3.1 Flash Lite leads 40.7 to 12.6.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 80% for Gemini 3.1 Flash Lite and 2.5% for Qwen2.5 7B Instruct.
  • Qwen2.5 7B Instruct is cheaper at $0.17 / $0.70 per million input/output tokens, against $0.25 / $1.50 for Gemini 3.1 Flash Lite.
  • Gemini 3.1 Flash Lite accepts more context: 1.05M tokens versus 131K.
  • Qwen2.5 7B Instruct has downloadable open weights; the other is API-only.

Side by side

Gemini 3.1 Flash Lite and Qwen2.5 7B Instruct specifications
Gemini 3.1 Flash LiteQwen2.5 7B Instruct
ProviderGoogleAlibaba (Qwen)
Noometry Index40.829.0
Released2026-03-032024-09
WeightsProprietaryOpen
Context window1.05M131K
Max output66K8K
Input $ / M tokens$0.25$0.17
Output $ / M tokens$1.50$0.70
Results tracked3815

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 37.8 (#188), Qwen2.5 7B Instruct: 36.5 (#208)

Coding benchmarks
BenchmarkGemini 3.1 Flash LiteQwen2.5 7B Instruct
LMArena WebDev1256—
SciCode41.9%—
WeirdML52.2%—
BigCodeBench Instruct—37.6%
LMArena Coding1400—
BigCodeBench Complete—46.1%
ALE-Bench797.73—

Agentic & Tool Use Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 30.2 (#79), Qwen2.5 7B Instruct: 23.8 (#124)

Agentic & Tool Use benchmarks
BenchmarkGemini 3.1 Flash LiteQwen2.5 7B Instruct
DeepResearch Bench37.3%—
BALROG—7.8%

Reasoning Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 22.9 (#186), Qwen2.5 7B Instruct: 14.8 (#322)

Reasoning benchmarks
BenchmarkGemini 3.1 Flash LiteQwen2.5 7B Instruct
Chess Puzzles25%0%
DTBench76.8%47.7%
LMCA35%6.4%
Epoch Capabilities Index144.47118.51
Kagi LLM Benchmark67.2%—
NYT Connections (extended)8.2%—
CritPt1.1%—
EnigmaEval3%—
Thematic Generalization63.3%—
LMArena Hard Prompts1407—
ForecastBench54.4—

Math Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 40.7 (#90), Qwen2.5 7B Instruct: 12.6 (#306)

Math benchmarks
BenchmarkGemini 3.1 Flash LiteQwen2.5 7B Instruct
OTIS Mock AIME 2024-202580%2.5%
FrontierMath (Tiers 1-3)27.7%—
Omni-MATH—29.4%
LMArena Math1428—

Knowledge Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 41.9 (#104), Qwen2.5 7B Instruct: 17.0 (#286)

Knowledge benchmarks
BenchmarkGemini 3.1 Flash LiteQwen2.5 7B Instruct
GPQA Diamond81.8%35.5%
Humanity's Last Exam8.6%—
MMLU-Pro—53.9%
Vectara Hallucination Rate8.2%—
GPQA (HELM)—34.1%
LMArena Expert1398—
MMLU—72.9%

Multimodal Not comparable

Gemini 3.1 Flash Lite: 39.4 (#60), Qwen2.5 7B Instruct: —

Multimodal benchmarks
BenchmarkGemini 3.1 Flash LiteQwen2.5 7B Instruct
LMArena Vision1240—

Multilingual Not comparable

Gemini 3.1 Flash Lite: 52.3 (#86), Qwen2.5 7B Instruct: —

Multilingual benchmarks
BenchmarkGemini 3.1 Flash LiteQwen2.5 7B Instruct
LMArena Non-English1411—
LMArena Chinese1461—
LMArena French1424—
LMArena German1429—
LMArena Japanese1413—
LMArena Korean1392—
LMArena Russian1420—
LMArena Spanish1421—

Instruction Following Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 72.7 (#131), Qwen2.5 7B Instruct: 63.2 (#231)

Instruction Following benchmarks
BenchmarkGemini 3.1 Flash LiteQwen2.5 7B Instruct
IFEval—74.1%
LMArena Instruction Following1377—

Long Context Not comparable

Gemini 3.1 Flash Lite: 42.5 (#122), Qwen2.5 7B Instruct: —

Long Context benchmarks
BenchmarkGemini 3.1 Flash LiteQwen2.5 7B Instruct
LMArena Longer Query1394—

Writing & Preference Gemini 3.1 Flash Lite leads

Gemini 3.1 Flash Lite: 60.9 (#94), Qwen2.5 7B Instruct: 48.8 (#195)

Writing & Preference benchmarks
BenchmarkGemini 3.1 Flash LiteQwen2.5 7B Instruct
LMArena Text1416—
LMArena Creative Writing1401—
WildBench—73.1%
LMArena Multi-Turn1417—

Frequently asked questions

Is Gemini 3.1 Flash Lite better than Qwen2.5 7B Instruct?

Gemini 3.1 Flash Lite is the stronger model overall, scoring 40.8 to 29.0 on the Noometry Index. Qwen2.5 7B Instruct costs 1.8× less per token, which makes it the better buy when Gemini 3.1 Flash Lite's lead doesn't matter for your workload.

Which is cheaper, Gemini 3.1 Flash Lite or Qwen2.5 7B Instruct?

Qwen2.5 7B Instruct is cheaper. It lists at $0.17 per million input tokens and $0.70 per million output tokens; Gemini 3.1 Flash Lite lists at $0.25 and $1.50.

Is Gemini 3.1 Flash Lite or Qwen2.5 7B Instruct better for coding?

Gemini 3.1 Flash Lite scores higher on coding benchmarks: 37.8 versus 36.5 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.1 Flash Lite does, with 1.05M tokens against 131K.

How many benchmarks do Gemini 3.1 Flash Lite and Qwen2.5 7B Instruct share?

6 benchmarks have published results for both models. Gemini 3.1 Flash Lite has 38 scored results on Noometry and Qwen2.5 7B Instruct has 15.

Related comparisons

Go deeper