Noometry

Model comparison

Gemini 2.0 Pro vs Qwen3-4B

Gemini 2.0 Pro is the stronger model overall, scoring 39.1 to 31.9 on the Noometry Index.

Last verified . 1 shared benchmarks.

Gemini 2.0 Pro Google

39.1

Rank #173 Confirmed

Qwen3-4B Alibaba (Qwen)

31.9

Rank #264 Confirmed

Summary

  • They share 1 benchmark with published results for both. Gemini 2.0 Pro scores higher in 3 categories and Qwen3-4B in 0 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 2.0 Pro leads 39.7 to 29.7.
  • The biggest single-benchmark swing is GPQA Diamond: 65.7% for Gemini 2.0 Pro and 52.3% for Qwen3-4B.
  • Qwen3-4B has downloadable open weights; the other is API-only.

Side by side

Gemini 2.0 ProQwen3-4B
ProviderGoogleAlibaba (Qwen)
Noometry Index39.131.9
Released2025-02-052025-04-29
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked146

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemini 2.0 Pro: 37.8 (#187), Qwen3-4B: —

BenchmarkGemini 2.0 ProQwen3-4B
Aider Polyglot35.6%—
LiveBench Coding63.5%—

Agentic & Tool Use Not comparable

Gemini 2.0 Pro: —, Qwen3-4B: 27.6 (#100)

BenchmarkGemini 2.0 ProQwen3-4B
Berkeley Function Calling Leaderboard—35.7%

Reasoning Gemini 2.0 Pro leads

Gemini 2.0 Pro: 22.3 (#198), Qwen3-4B: 19.2 (#268)

BenchmarkGemini 2.0 ProQwen3-4B
Chess Puzzles—4%
EnigmaEval0.7%—
LiveBench Reasoning60.1%—
LiveBench Data Analysis68%—
Epoch Capabilities Index135.06—
LiveBench65.1%—

Math Gemini 2.0 Pro leads

Gemini 2.0 Pro: 39.7 (#100), Qwen3-4B: 29.7 (#240)

BenchmarkGemini 2.0 ProQwen3-4B
MathArena Final-Answer Competitions—38.5%
OTIS Mock AIME 2024-2025—52.2%
LiveBench Math71%—
MATH Level 583.5%—

Knowledge Gemini 2.0 Pro leads

Gemini 2.0 Pro: 36.5 (#167), Qwen3-4B: 33.0 (#208)

BenchmarkGemini 2.0 ProQwen3-4B
GPQA Diamond65.7%52.3%
Confabulations18.4%—
Vectara Hallucination Rate—5.7%

Instruction Following Not comparable

Gemini 2.0 Pro: 75.5 (#59), Qwen3-4B: —

BenchmarkGemini 2.0 ProQwen3-4B
LiveBench Instruction Following83.4%—

Long Context Not comparable

Gemini 2.0 Pro: 29.2 (#292), Qwen3-4B: —

BenchmarkGemini 2.0 ProQwen3-4B
Fiction.LiveBench41.7%—

Writing & Preference Not comparable

Gemini 2.0 Pro: 52.7 (#165), Qwen3-4B: —

BenchmarkGemini 2.0 ProQwen3-4B
LiveBench Language44.9%—

Frequently asked questions

Is Gemini 2.0 Pro better than Qwen3-4B?

Gemini 2.0 Pro is the stronger model overall, scoring 39.1 to 31.9 on the Noometry Index.

How many benchmarks do Gemini 2.0 Pro and Qwen3-4B share?

1 benchmark has published results for both models. Gemini 2.0 Pro has 14 scored results on Noometry and Qwen3-4B has 6.

Related comparisons

Go deeper