Noometry

Model comparison

Gemini 2.0 Pro vs Qwen2.5-Coder (1.5B)

Gemini 2.0 Pro has enough public results to be ranked (#173); Qwen2.5-Coder (1.5B) does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Gemini 2.0 Pro Google

39.1

Rank #173 Confirmed

Qwen2.5-Coder (1.5B) Alibaba (Qwen)

—

Unranked

Summary

  • They share 1 benchmark with published results for both.
  • Qwen2.5-Coder (1.5B) has downloadable open weights; the other is API-only.

Side by side

Gemini 2.0 ProQwen2.5-Coder (1.5B)
ProviderGoogleAlibaba (Qwen)
Noometry Index39.1—
Released2025-02-052024-09-18
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked146

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemini 2.0 Pro: 37.8 (#187), Qwen2.5-Coder (1.5B): —

BenchmarkGemini 2.0 ProQwen2.5-Coder (1.5B)
Aider Polyglot35.6%—
LiveBench Coding63.5%—

Reasoning Not comparable

Gemini 2.0 Pro: 22.3 (#198), Qwen2.5-Coder (1.5B): —

BenchmarkGemini 2.0 ProQwen2.5-Coder (1.5B)
Epoch Capabilities Index135.06113.14
EnigmaEval0.7%—
LiveBench Reasoning60.1%—
LiveBench Data Analysis68%—
HellaSwag—76.8%
LiveBench65.1%—
WinoGrande—72.9%

Math Not comparable

Gemini 2.0 Pro: 39.7 (#100), Qwen2.5-Coder (1.5B): —

BenchmarkGemini 2.0 ProQwen2.5-Coder (1.5B)
LiveBench Math71%—
MATH Level 583.5%—
GSM8K—86.7%

Knowledge Not comparable

Gemini 2.0 Pro: 36.5 (#167), Qwen2.5-Coder (1.5B): —

BenchmarkGemini 2.0 ProQwen2.5-Coder (1.5B)
GPQA Diamond65.7%—
Confabulations18.4%—
ARC (AI2) Challenge—60.9%
MMLU—68%

Instruction Following Not comparable

Gemini 2.0 Pro: 75.5 (#59), Qwen2.5-Coder (1.5B): —

BenchmarkGemini 2.0 ProQwen2.5-Coder (1.5B)
LiveBench Instruction Following83.4%—

Long Context Not comparable

Gemini 2.0 Pro: 29.2 (#292), Qwen2.5-Coder (1.5B): —

BenchmarkGemini 2.0 ProQwen2.5-Coder (1.5B)
Fiction.LiveBench41.7%—

Writing & Preference Not comparable

Gemini 2.0 Pro: 52.7 (#165), Qwen2.5-Coder (1.5B): —

BenchmarkGemini 2.0 ProQwen2.5-Coder (1.5B)
LiveBench Language44.9%—

Frequently asked questions

Is Gemini 2.0 Pro better than Qwen2.5-Coder (1.5B)?

Gemini 2.0 Pro has enough public results to be ranked (#173); Qwen2.5-Coder (1.5B) does not yet, so treat this comparison as directional.

How many benchmarks do Gemini 2.0 Pro and Qwen2.5-Coder (1.5B) share?

1 benchmark has published results for both models. Gemini 2.0 Pro has 14 scored results on Noometry and Qwen2.5-Coder (1.5B) has 6.

Related comparisons

Go deeper