Noometry

Model comparison

Gemini 3.5 Flash vs Qwen2.5 72B Instruct

Gemini 3.5 Flash is the stronger model overall, scoring 54.1 to 31.5 on the Noometry Index.

Last verified . 24 shared benchmarks.

Gemini 3.5 Flash Google

54.1

Rank #29 Confirmed

Qwen2.5 72B Instruct Alibaba (Qwen)

31.5

Rank #259 Confirmed

Summary

  • They share 24 benchmarks with published results for both. Gemini 3.5 Flash scores higher in 9 categories and Qwen2.5 72B Instruct in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 3.5 Flash leads 60.5 to 18.1.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 95.6% for Gemini 3.5 Flash and 8.1% for Qwen2.5 72B Instruct.
  • Qwen2.5 72B Instruct is cheaper at $1.40 / $5.60 per million input/output tokens, against $1.50 / $9 for Gemini 3.5 Flash.
  • Gemini 3.5 Flash accepts more context: 1.05M tokens versus 131K.
  • Qwen2.5 72B Instruct has downloadable open weights; the other is API-only.

Side by side

Gemini 3.5 FlashQwen2.5 72B Instruct
ProviderGoogleAlibaba (Qwen)
Noometry Index54.131.5
Released2026-05-192024-09
WeightsProprietaryOpen
Context window1.05M131K
Max output66K8K
Input $ / M tokens$1.50$1.40
Output $ / M tokens$9$5.60
Results tracked5443

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.5 Flash leads

Gemini 3.5 Flash: 49.1 (#46), Qwen2.5 72B Instruct: 32.8 (#256)

BenchmarkGemini 3.5 FlashQwen2.5 72B Instruct
WeirdML62.6%16%
LMArena Coding14921293
SWE-bench Verified79.3%—
DeepSWE37.4%—
LMArena WebDev1499—
SciCode53.1%—
BigCodeBench Instruct—45.8%
BigCodeBench Complete—55.9%
ALE-Bench911.02—

Agentic & Tool Use Gemini 3.5 Flash leads

Gemini 3.5 Flash: 24.8 (#107), Qwen2.5 72B Instruct: 22.0 (#124)

BenchmarkGemini 3.5 FlashQwen2.5 72B Instruct
APEX-Agents27.5%—
TheAgentCompany—5.7%
BALROG—16.2%
GBAEval6.7%—
GDP.pdf14%—
METR Time Horizons—35.8%
Vending-Bench 25,396—

Reasoning Gemini 3.5 Flash leads

Gemini 3.5 Flash: 62.7 (#16), Qwen2.5 72B Instruct: 21.4 (#197)

BenchmarkGemini 3.5 FlashQwen2.5 72B Instruct
LMArena Hard Prompts14881271
DTBench94.7%62.9%
LMCA47.1%13.4%
Epoch Capabilities Index154.55129.01
ForecastBench5957.5
ARC-AGI-272.1%—
SimpleBench76.7%—
NYT Connections (extended)92.6%—
ARC-AGI-192.5%—
CritPt13.1%—
Chess Puzzles50%—
EnigmaEval25.4%—
EBR-Bench4.8%—
Mystery Game Puzzles32%—
Surface Evolver Bench58.1%—
BIG-Bench Hard—79.8%
HellaSwag—84.8%
PIQA—82.6%
WinoGrande—82.3%

Math Gemini 3.5 Flash leads

Gemini 3.5 Flash: 60.5 (#30), Qwen2.5 72B Instruct: 18.1 (#281)

BenchmarkGemini 3.5 FlashQwen2.5 72B Instruct
OTIS Mock AIME 2024-202595.6%8.1%
LMArena Math15021283
FrontierMath (Tiers 1-3)62.8%—
FrontierMath Tier 426.8%—
MathArena Final-Answer Competitions76.3%—
ProofBench31%—
Omni-MATH—33%
MATH Level 5—63.2%
FrontierMath (Feb 2025 set)39%—
FrontierMath Tier 4 (v1)14.6%—

Knowledge Gemini 3.5 Flash leads

Gemini 3.5 Flash: 66.3 (#10), Qwen2.5 72B Instruct: 26.9 (#247)

BenchmarkGemini 3.5 FlashQwen2.5 72B Instruct
GPQA Diamond92.8%49.1%
LMArena Expert14931245
SimpleQA Verified66.2%—
MMLU-Pro—63.1%
Confabulations—19.1%
GPQA (HELM)—42.6%
ARC (AI2) Challenge—94.5%
MMLU—85.3%
TriviaQA—71.9%

Multimodal Not comparable

Gemini 3.5 Flash: 45.7 (#13), Qwen2.5 72B Instruct: —

BenchmarkGemini 3.5 FlashQwen2.5 72B Instruct
LMArena Vision1311—
Blueprint-Bench 233.6%—
LMArena Document1463—

Multilingual Gemini 3.5 Flash leads

Gemini 3.5 Flash: 57.1 (#12), Qwen2.5 72B Instruct: 41.2 (#208)

BenchmarkGemini 3.5 FlashQwen2.5 72B Instruct
LMArena Non-English14751252
LMArena Chinese15251272
LMArena French14901279
LMArena German15001234
LMArena Japanese14811180
LMArena Korean14531188
LMArena Russian14911264
LMArena Spanish14781255

Instruction Following Gemini 3.5 Flash leads

Gemini 3.5 Flash: 77.2 (#29), Qwen2.5 72B Instruct: 65.7 (#216)

BenchmarkGemini 3.5 FlashQwen2.5 72B Instruct
LMArena Instruction Following14661254
IFEval—80.6%

Long Context Gemini 3.5 Flash leads

Gemini 3.5 Flash: 45.3 (#39), Qwen2.5 72B Instruct: 38.9 (#183)

BenchmarkGemini 3.5 FlashQwen2.5 72B Instruct
LMArena Longer Query14811282

Writing & Preference Gemini 3.5 Flash leads

Gemini 3.5 Flash: 65.5 (#46), Qwen2.5 72B Instruct: 46.9 (#210)

BenchmarkGemini 3.5 FlashQwen2.5 72B Instruct
LMArena Text14811269
LMArena Creative Writing14671221
LMArena Multi-Turn14821272
WildBench—80.2%
EQ-Bench 41087—

Frequently asked questions

Is Gemini 3.5 Flash better than Qwen2.5 72B Instruct?

Gemini 3.5 Flash is the stronger model overall, scoring 54.1 to 31.5 on the Noometry Index.

Which is cheaper, Gemini 3.5 Flash or Qwen2.5 72B Instruct?

Qwen2.5 72B Instruct is cheaper. It lists at $1.40 per million input tokens and $5.60 per million output tokens; Gemini 3.5 Flash lists at $1.50 and $9.

Is Gemini 3.5 Flash or Qwen2.5 72B Instruct better for coding?

Gemini 3.5 Flash scores higher on coding benchmarks: 49.1 versus 32.8 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.5 Flash does, with 1.05M tokens against 131K.

How many benchmarks do Gemini 3.5 Flash and Qwen2.5 72B Instruct share?

24 benchmarks have published results for both models. Gemini 3.5 Flash has 54 scored results on Noometry and Qwen2.5 72B Instruct has 43.

Related comparisons

Go deeper