Noometry

Model comparison

Gemini Advanced 0514 vs Qwen2.5 72B Instruct

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 31.9 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemini Advanced 0514 Google

37.7

Rank #197 Confirmed

Qwen2.5 72B Instruct Alibaba (Qwen)

31.9

Rank #267 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemini Advanced 0514 scores higher in 7 categories and Qwen2.5 72B Instruct in 1 category; 6 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini Advanced 0514 leads 35.5 to 19.3.
  • Qwen2.5 72B Instruct has downloadable open weights; the other is API-only.

Side by side

Gemini Advanced 0514Qwen2.5 72B Instruct
ProviderGoogleAlibaba (Qwen)
Noometry Index37.731.9
Released—2024-09
WeightsProprietaryOpen
Context window—131K
Max output—8K
Input $ / M tokens—$1.40
Output $ / M tokens—$5.60
Results tracked1743

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini Advanced 0514 leads

Gemini Advanced 0514: 36.6 (#205), Qwen2.5 72B Instruct: 33.2 (#260)

BenchmarkGemini Advanced 0514Qwen2.5 72B Instruct
LMArena Coding12551292
WeirdML—16%
BigCodeBench Instruct—45.8%
BigCodeBench Complete—55.9%

Agentic & Tool Use Not comparable

Gemini Advanced 0514: —, Qwen2.5 72B Instruct: 22.1 (#133)

BenchmarkGemini Advanced 0514Qwen2.5 72B Instruct
TheAgentCompany—5.7%
BALROG—16.2%
METR Time Horizons—35.8%

Reasoning Gemini Advanced 0514 leads

Gemini Advanced 0514: 24.6 (#160), Qwen2.5 72B Instruct: 22.3 (#199)

BenchmarkGemini Advanced 0514Qwen2.5 72B Instruct
LMArena Hard Prompts12481271
DTBench—62.9%
LMCA—13.4%
BIG-Bench Hard—79.8%
Epoch Capabilities Index—129
ForecastBench—57.5
HellaSwag—84.8%
PIQA—82.6%
WinoGrande—82.3%

Math Gemini Advanced 0514 leads

Gemini Advanced 0514: 35.5 (#181), Qwen2.5 72B Instruct: 19.3 (#287)

BenchmarkGemini Advanced 0514Qwen2.5 72B Instruct
LMArena Math12721283
OTIS Mock AIME 2024-2025—8.1%
Omni-MATH—33%
MATH Level 5—63.2%

Knowledge Gemini Advanced 0514 leads

Gemini Advanced 0514: 33.3 (#205), Qwen2.5 72B Instruct: 27.0 (#253)

BenchmarkGemini Advanced 0514Qwen2.5 72B Instruct
LMArena Expert12151245
GPQA Diamond—49.1%
MMLU-Pro—63.1%
Confabulations—19.1%
GPQA (HELM)—42.6%
ARC (AI2) Challenge—94.5%
MMLU—85.3%
TriviaQA—71.9%

Multilingual Gemini Advanced 0514 leads

Gemini Advanced 0514: 42.6 (#192), Qwen2.5 72B Instruct: 41.0 (#213)

BenchmarkGemini Advanced 0514Qwen2.5 72B Instruct
LMArena Non-English12741252
LMArena Chinese12741272
LMArena French13071280
LMArena German12751234
LMArena Japanese12421180
LMArena Korean12321188
LMArena Russian12831264
LMArena Spanish12421256

Instruction Following Too close to call

Gemini Advanced 0514: 66.0 (#212), Qwen2.5 72B Instruct: 65.5 (#221)

BenchmarkGemini Advanced 0514Qwen2.5 72B Instruct
LMArena Instruction Following12531254
IFEval—80.6%

Long Context Too close to call

Gemini Advanced 0514: 38.0 (#207), Qwen2.5 72B Instruct: 38.9 (#188)

BenchmarkGemini Advanced 0514Qwen2.5 72B Instruct
LMArena Longer Query12531282

Writing & Preference Gemini Advanced 0514 leads

Gemini Advanced 0514: 48.5 (#200), Qwen2.5 72B Instruct: 46.7 (#215)

BenchmarkGemini Advanced 0514Qwen2.5 72B Instruct
LMArena Text12791269
LMArena Creative Writing12841221
LMArena Multi-Turn12691272
WildBench—80.2%

Frequently asked questions

Is Gemini Advanced 0514 better than Qwen2.5 72B Instruct?

Gemini Advanced 0514 is the stronger model overall, scoring 37.7 to 31.9 on the Noometry Index.

Is Gemini Advanced 0514 or Qwen2.5 72B Instruct better for coding?

Gemini Advanced 0514 scores higher on coding benchmarks: 36.6 versus 33.2 in the Noometry coding category.

How many benchmarks do Gemini Advanced 0514 and Qwen2.5 72B Instruct share?

17 benchmarks have published results for both models. Gemini Advanced 0514 has 17 scored results on Noometry and Qwen2.5 72B Instruct has 43.

Related comparisons

Go deeper