Noometry

Model comparison

Gemini 2.5 Flash vs Qwen Max

Gemini 2.5 Flash is the stronger model overall, scoring 39.3 to 34.7 on the Noometry Index.

Last verified . 21 shared benchmarks.

Gemini 2.5 Flash Google

39.3

Rank #170 Confirmed

Qwen Max Alibaba (Qwen)

34.7

Rank #230 Confirmed

Summary

  • They share 21 benchmarks with published results for both. Gemini 2.5 Flash scores higher in 7 categories and Qwen Max in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 2.5 Flash leads 39.9 to 22.3.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 73.1% for Gemini 2.5 Flash and 16.1% for Qwen Max.
  • Gemini 2.5 Flash is cheaper at $0.30 / $2.50 per million input/output tokens, against $1.60 / $6.40 for Qwen Max.
  • Gemini 2.5 Flash accepts more context: 1.05M tokens versus 33K.

Side by side

Gemini 2.5 FlashQwen Max
ProviderGoogleAlibaba (Qwen)
Noometry Index39.334.7
Released2025-04-172024-04-03
WeightsProprietaryProprietary
Context window1.05M33K
Max output66K8K
Input $ / M tokens$0.30$1.60
Output $ / M tokens$2.50$6.40
Results tracked5423

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.5 Flash leads

Gemini 2.5 Flash: 35.8 (#220), Qwen Max: 30.7 (#292)

BenchmarkGemini 2.5 FlashQwen Max
Aider Polyglot55.1%21.8%
LMArena Coding14241288
SWE-bench Verified (bash only)28.7%—
WeirdML41.9%—
ALE-Bench661.88—

Agentic & Tool Use Not comparable

Gemini 2.5 Flash: 30.8 (#74), Qwen Max: —

BenchmarkGemini 2.5 FlashQwen Max
Terminal-Bench17.1%—
Berkeley Function Calling Leaderboard56.2%—
TheAgentCompany41.1%—
BALROG33.5%—
Vending-Bench 2548.84—

Reasoning Qwen Max leads

Gemini 2.5 Flash: 18.1 (#286), Qwen Max: 25.1 (#151)

BenchmarkGemini 2.5 FlashQwen Max
LMArena Hard Prompts14221269
ARC-AGI-22.5%—
SimpleBench41.2%—
Kagi LLM Benchmark56.8%—
ARC-AGI-133.3%—
CritPt1.1%—
EnigmaEval2.7%—
DTBench76.5%—
LMCA27.5%—
Epoch Capabilities Index143.03—
ForecastBench60.6—

Math Gemini 2.5 Flash leads

Gemini 2.5 Flash: 39.9 (#98), Qwen Max: 22.3 (#276)

BenchmarkGemini 2.5 FlashQwen Max
OTIS Mock AIME 2024-202573.1%16.1%
LMArena Math14151275
FrontierMath (Feb 2025 set)4.8%1%
Omni-MATH38.5%—
MATH Level 5—67.2%
FrontierMath Tier 4 (v1)4.2%—

Knowledge Gemini 2.5 Flash leads

Gemini 2.5 Flash: 36.4 (#168), Qwen Max: 30.3 (#228)

BenchmarkGemini 2.5 FlashQwen Max
LMArena Expert14261248
GPQA Diamond—56.1%
Humanity's Last Exam12.1%—
MMLU-Pro63.9%—
Confabulations16.8%—
Vectara Hallucination Rate7.8%—
GPQA (HELM)39%—

Multimodal Not comparable

Gemini 2.5 Flash: 41.8 (#32), Qwen Max: —

BenchmarkGemini 2.5 FlashQwen Max
LMArena Vision1253—
GeoBench76%—
VPCT46.2%—
SpatialViz-Bench36.9%—

Multilingual Gemini 2.5 Flash leads

Gemini 2.5 Flash: 52.3 (#88), Qwen Max: 41.8 (#202)

BenchmarkGemini 2.5 FlashQwen Max
LMArena Non-English14091263
LMArena Chinese14501254
LMArena French14331330
LMArena German14181254
LMArena Japanese14051205
LMArena Korean13851142
LMArena Russian14151274
LMArena Spanish14211290

Instruction Following Gemini 2.5 Flash leads

Gemini 2.5 Flash: 75.7 (#54), Qwen Max: 66.5 (#208)

BenchmarkGemini 2.5 FlashQwen Max
LMArena Instruction Following14051262
IFEval89.8%—

Long Context Gemini 2.5 Flash leads

Gemini 2.5 Flash: 47.5 (#17), Qwen Max: 39.4 (#180)

BenchmarkGemini 2.5 FlashQwen Max
Fiction.LiveBench77.8%66.7%
LMArena Longer Query14191288

Writing & Preference Gemini 2.5 Flash leads

Gemini 2.5 Flash: 53.8 (#157), Qwen Max: 47.8 (#205)

BenchmarkGemini 2.5 FlashQwen Max
LMArena Text14171282
LMArena Creative Writing14001248
LMArena Multi-Turn14081277
Short-Story Creative Writing76.5%—
EQ-Bench Creative Writing1137—
WildBench81.7%—

Frequently asked questions

Is Gemini 2.5 Flash better than Qwen Max?

Gemini 2.5 Flash is the stronger model overall, scoring 39.3 to 34.7 on the Noometry Index.

Which is cheaper, Gemini 2.5 Flash or Qwen Max?

Gemini 2.5 Flash is cheaper. It lists at $0.30 per million input tokens and $2.50 per million output tokens; Qwen Max lists at $1.60 and $6.40.

Is Gemini 2.5 Flash or Qwen Max better for coding?

Gemini 2.5 Flash scores higher on coding benchmarks: 35.8 versus 30.7 in the Noometry coding category.

Which has the bigger context window?

Gemini 2.5 Flash does, with 1.05M tokens against 33K.

How many benchmarks do Gemini 2.5 Flash and Qwen Max share?

21 benchmarks have published results for both models. Gemini 2.5 Flash has 54 scored results on Noometry and Qwen Max has 23.

Related comparisons

Go deeper