Model comparison

Gemini 2.0 Pro vs Qwen1.5-32B

Gemini 2.0 Pro is the stronger model overall, scoring 39.1 to 30.5 on the Noometry Index.

Last verified . 1 shared benchmarks.

Gemini 2.0 Pro Google

39.1

Rank #173 Confirmed

Qwen1.5-32B Alibaba (Qwen)

30.5

Rank #293 Confirmed

Summary

  • They share 1 benchmark with published results for both. Gemini 2.0 Pro scores higher in 6 categories and Qwen1.5-32B in 1 category; 6 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 2.0 Pro leads 36.5 to 13.5.
  • The biggest single-benchmark swing is GPQA Diamond: 65.7% for Gemini 2.0 Pro and 30.7% for Qwen1.5-32B.
  • Qwen1.5-32B has downloadable open weights; the other is API-only.

Side by side

Gemini 2.0 Pro and Qwen1.5-32B specifications
Gemini 2.0 ProQwen1.5-32B
ProviderGoogleAlibaba (Qwen)
Noometry Index39.130.5
Released2025-02-052024-02-04
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1421

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.0 Pro leads

Gemini 2.0 Pro: 37.8 (#187), Qwen1.5-32B: 31.7 (#282)

Coding benchmarks
BenchmarkGemini 2.0 ProQwen1.5-32B
Aider Polyglot35.6%—
BigCodeBench Instruct—32.3%
LiveBench Coding63.5%—
LMArena Coding—1155
BigCodeBench Complete—42%

Reasoning Too close to call

Gemini 2.0 Pro: 22.3 (#198), Qwen1.5-32B: 21.8 (#212)

Reasoning benchmarks
BenchmarkGemini 2.0 ProQwen1.5-32B
EnigmaEval0.7%—
LiveBench Reasoning60.1%—
LMArena Hard Prompts—1130
LiveBench Data Analysis68%—
Epoch Capabilities Index135.06—
LiveBench65.1%—

Math Gemini 2.0 Pro leads

Gemini 2.0 Pro: 39.7 (#100), Qwen1.5-32B: 33.0 (#207)

Math benchmarks
BenchmarkGemini 2.0 ProQwen1.5-32B
LiveBench Math71%—
LMArena Math—1155
MATH Level 583.5%—

Knowledge Gemini 2.0 Pro leads

Gemini 2.0 Pro: 36.5 (#167), Qwen1.5-32B: 13.5 (#296)

Knowledge benchmarks
BenchmarkGemini 2.0 ProQwen1.5-32B
GPQA Diamond65.7%30.7%
Confabulations18.4%—
LMArena Expert—1126
MMLU—74.4%

Multilingual Not comparable

Gemini 2.0 Pro: —, Qwen1.5-32B: 31.4 (#259)

Multilingual benchmarks
BenchmarkGemini 2.0 ProQwen1.5-32B
LMArena Non-English—1106
LMArena Chinese—1177
LMArena French—1101
LMArena German—1058
LMArena Japanese—1027
LMArena Korean—1008
LMArena Russian—1073
LMArena Spanish—1089

Instruction Following Gemini 2.0 Pro leads

Gemini 2.0 Pro: 75.5 (#59), Qwen1.5-32B: 57.7 (#265)

Instruction Following benchmarks
BenchmarkGemini 2.0 ProQwen1.5-32B
LiveBench Instruction Following83.4%—
LMArena Instruction Following—1116

Long Context Qwen1.5-32B leads

Gemini 2.0 Pro: 29.2 (#292), Qwen1.5-32B: 34.7 (#246)

Long Context benchmarks
BenchmarkGemini 2.0 ProQwen1.5-32B
Fiction.LiveBench41.7%—
LMArena Longer Query—1146

Writing & Preference Gemini 2.0 Pro leads

Gemini 2.0 Pro: 52.7 (#165), Qwen1.5-32B: 34.2 (#271)

Writing & Preference benchmarks
BenchmarkGemini 2.0 ProQwen1.5-32B
LMArena Text—1137
LMArena Creative Writing—1083
LMArena Multi-Turn—1140
LiveBench Language44.9%—

Frequently asked questions

Is Gemini 2.0 Pro better than Qwen1.5-32B?

Gemini 2.0 Pro is the stronger model overall, scoring 39.1 to 30.5 on the Noometry Index.

Is Gemini 2.0 Pro or Qwen1.5-32B better for coding?

Gemini 2.0 Pro scores higher on coding benchmarks: 37.8 versus 31.7 in the Noometry coding category.

How many benchmarks do Gemini 2.0 Pro and Qwen1.5-32B share?

1 benchmark has published results for both models. Gemini 2.0 Pro has 14 scored results on Noometry and Qwen1.5-32B has 21.

Related comparisons

Go deeper