Noometry

Model comparison

Gemini 3.7 Flash vs Qwen2.5 72B Instruct

Gemini 3.7 Flash is the stronger model overall, scoring 59.8 to 31.9 on the Noometry Index.

Last verified . 22 shared benchmarks.

Gemini 3.7 Flash Google

59.8

Rank #14 Confirmed

Qwen2.5 72B Instruct Alibaba (Qwen)

31.9

Rank #267 Confirmed

Summary

  • They share 22 benchmarks with published results for both. Gemini 3.7 Flash scores higher in 9 categories and Qwen2.5 72B Instruct in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 3.7 Flash leads 69.6 to 19.3.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 97.2% for Gemini 3.7 Flash and 8.1% for Qwen2.5 72B Instruct.
  • Gemini 3.7 Flash is cheaper at $0.75 / $3.75 per million input/output tokens, against $1.40 / $5.60 for Qwen2.5 72B Instruct.
  • Gemini 3.7 Flash accepts more context: 1.05M tokens versus 131K.
  • Qwen2.5 72B Instruct has downloadable open weights; the other is API-only.

Side by side

Gemini 3.7 FlashQwen2.5 72B Instruct
ProviderGoogleAlibaba (Qwen)
Noometry Index59.831.9
Released2026-08-132024-09
WeightsProprietaryOpen
Context window1.05M131K
Max output66K8K
Input $ / M tokens$0.75$1.40
Output $ / M tokens$3.75$5.60
Results tracked4443

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.7 Flash leads

Gemini 3.7 Flash: 56.2 (#22), Qwen2.5 72B Instruct: 33.2 (#260)

BenchmarkGemini 3.7 FlashQwen2.5 72B Instruct
LMArena Coding14971292
DeepSWE65.5%—
FrontierCode43.6%—
LMArena WebDev1592—
FrontierSWE20.3%—
SciCode59.8%—
WeirdML—16%
BigCodeBench Instruct—45.8%
BigCodeBench Complete—55.9%
ALE-Bench904.3—

Agentic & Tool Use Gemini 3.7 Flash leads

Gemini 3.7 Flash: 42.1 (#19), Qwen2.5 72B Instruct: 22.1 (#133)

BenchmarkGemini 3.7 FlashQwen2.5 72B Instruct
APEX-Agents67.8%—
Remote Labor Index5%—
TheAgentCompany—5.7%
BALROG—16.2%
GDP.pdf23.8%—
METR Time Horizons—35.8%

Reasoning Gemini 3.7 Flash leads

Gemini 3.7 Flash: 70.0 (#15), Qwen2.5 72B Instruct: 22.3 (#199)

BenchmarkGemini 3.7 FlashQwen2.5 72B Instruct
LMArena Hard Prompts14941271
DTBench96.8%62.9%
LMCA50.4%13.4%
Epoch Capabilities Index157.27129
ARC-AGI-284.6%—
NYT Connections (extended)94%—
ARC-AGI-195.5%—
CritPt14.3%—
Chess Puzzles47%—
Mystery Game Puzzles37%—
BIG-Bench Hard—79.8%
ForecastBench—57.5
HellaSwag—84.8%
PIQA—82.6%
WinoGrande—82.3%

Math Gemini 3.7 Flash leads

Gemini 3.7 Flash: 69.6 (#23), Qwen2.5 72B Instruct: 19.3 (#287)

BenchmarkGemini 3.7 FlashQwen2.5 72B Instruct
OTIS Mock AIME 2024-202597.2%8.1%
LMArena Math15071283
FrontierMath (Tiers 1-3)71.6%—
FrontierMath Tier 436.6%—
ProofBench58%—
Omni-MATH—33%
MATH Level 5—63.2%

Knowledge Gemini 3.7 Flash leads

Gemini 3.7 Flash: 69.7 (#5), Qwen2.5 72B Instruct: 27.0 (#253)

BenchmarkGemini 3.7 FlashQwen2.5 72B Instruct
GPQA Diamond94.8%49.1%
LMArena Expert15081245
SimpleQA Verified69.2%—
MMLU-Pro—63.1%
Confabulations—19.1%
GPQA (HELM)—42.6%
ARC (AI2) Challenge—94.5%
MMLU—85.3%
TriviaQA—71.9%

Multimodal Not comparable

Gemini 3.7 Flash: 37.3 (#73), Qwen2.5 72B Instruct: —

BenchmarkGemini 3.7 FlashQwen2.5 72B Instruct
LMArena Vision1316—
Furniture Assembly26.7%—

Multilingual Gemini 3.7 Flash leads

Gemini 3.7 Flash: 57.6 (#7), Qwen2.5 72B Instruct: 41.0 (#213)

BenchmarkGemini 3.7 FlashQwen2.5 72B Instruct
LMArena Non-English14841252
LMArena Chinese15481272
LMArena French15051280
LMArena German14981234
LMArena Japanese15121180
LMArena Korean14831188
LMArena Russian15161264
LMArena Spanish15031256

Instruction Following Gemini 3.7 Flash leads

Gemini 3.7 Flash: 77.7 (#15), Qwen2.5 72B Instruct: 65.5 (#221)

BenchmarkGemini 3.7 FlashQwen2.5 72B Instruct
LMArena Instruction Following14831254
IFEval—80.6%

Long Context Gemini 3.7 Flash leads

Gemini 3.7 Flash: 45.7 (#30), Qwen2.5 72B Instruct: 38.9 (#188)

BenchmarkGemini 3.7 FlashQwen2.5 72B Instruct
LMArena Longer Query14921282

Writing & Preference Gemini 3.7 Flash leads

Gemini 3.7 Flash: 71.2 (#20), Qwen2.5 72B Instruct: 46.7 (#215)

BenchmarkGemini 3.7 FlashQwen2.5 72B Instruct
LMArena Text14861269
LMArena Creative Writing14901221
LMArena Multi-Turn14891272
EQ-Bench Creative Writing1723—
WildBench—80.2%

Frequently asked questions

Is Gemini 3.7 Flash better than Qwen2.5 72B Instruct?

Gemini 3.7 Flash is the stronger model overall, scoring 59.8 to 31.9 on the Noometry Index.

Which is cheaper, Gemini 3.7 Flash or Qwen2.5 72B Instruct?

Gemini 3.7 Flash is cheaper. It lists at $0.75 per million input tokens and $3.75 per million output tokens; Qwen2.5 72B Instruct lists at $1.40 and $5.60.

Is Gemini 3.7 Flash or Qwen2.5 72B Instruct better for coding?

Gemini 3.7 Flash scores higher on coding benchmarks: 56.2 versus 33.2 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.7 Flash does, with 1.05M tokens against 131K.

How many benchmarks do Gemini 3.7 Flash and Qwen2.5 72B Instruct share?

22 benchmarks have published results for both models. Gemini 3.7 Flash has 44 scored results on Noometry and Qwen2.5 72B Instruct has 43.

Related comparisons

Go deeper