Model comparison

Gemma 3 1B vs Qwen Max

Qwen Max is the stronger model overall, scoring 34.7 to 21.1 on the Noometry Index.

Last verified . 2 shared benchmarks.

Gemma 3 1B Google

21.1

Rank #353 Reported

Qwen Max Alibaba (Qwen)

34.7

Rank #230 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Gemma 3 1B scores higher in 0 categories and Qwen Max in 3 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen Max leads 30.3 to 7.0.
  • The biggest single-benchmark swing is GPQA Diamond: 19.9% for Gemma 3 1B and 56.1% for Qwen Max.
  • Gemma 3 1B has downloadable open weights; the other is API-only.

Side by side

Gemma 3 1B and Qwen Max specifications
Gemma 3 1BQwen Max
ProviderGoogleAlibaba (Qwen)
Noometry Index21.134.7
Released2025-03-122024-04-03
WeightsOpenProprietary
Context window—33K
Max output—8K
Input $ / M tokens—$1.60
Output $ / M tokens—$6.40
Results tracked423

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Qwen Max: 30.7 (#292)

Coding benchmarks
BenchmarkGemma 3 1BQwen Max
Aider Polyglot—21.8%
LMArena Coding—1288

Agentic & Tool Use Not comparable

Gemma 3 1B: 13.7 (#152), Qwen Max: —

Agentic & Tool Use benchmarks
BenchmarkGemma 3 1BQwen Max
Berkeley Function Calling Leaderboard7.2%—

Reasoning Qwen Max leads

Gemma 3 1B: 19.2 (#264), Qwen Max: 25.1 (#151)

Reasoning benchmarks
BenchmarkGemma 3 1BQwen Max
Chess Puzzles0%—
LMArena Hard Prompts—1269

Math Qwen Max leads

Gemma 3 1B: 10.2 (#316), Qwen Max: 22.3 (#276)

Math benchmarks
BenchmarkGemma 3 1BQwen Max
OTIS Mock AIME 2024-20251.1%16.1%
LMArena Math—1275
MATH Level 5—67.2%
FrontierMath (Feb 2025 set)—1%

Knowledge Qwen Max leads

Gemma 3 1B: 7.0 (#314), Qwen Max: 30.3 (#228)

Knowledge benchmarks
BenchmarkGemma 3 1BQwen Max
GPQA Diamond19.9%56.1%
LMArena Expert—1248

Multilingual Not comparable

Gemma 3 1B: —, Qwen Max: 41.8 (#202)

Multilingual benchmarks
BenchmarkGemma 3 1BQwen Max
LMArena Non-English—1263
LMArena Chinese—1254
LMArena French—1330
LMArena German—1254
LMArena Japanese—1205
LMArena Korean—1142
LMArena Russian—1274
LMArena Spanish—1290

Instruction Following Not comparable

Gemma 3 1B: —, Qwen Max: 66.5 (#208)

Instruction Following benchmarks
BenchmarkGemma 3 1BQwen Max
LMArena Instruction Following—1262

Long Context Not comparable

Gemma 3 1B: —, Qwen Max: 39.4 (#180)

Long Context benchmarks
BenchmarkGemma 3 1BQwen Max
Fiction.LiveBench—66.7%
LMArena Longer Query—1288

Writing & Preference Not comparable

Gemma 3 1B: —, Qwen Max: 47.8 (#205)

Writing & Preference benchmarks
BenchmarkGemma 3 1BQwen Max
LMArena Text—1282
LMArena Creative Writing—1248
LMArena Multi-Turn—1277

Frequently asked questions

Is Gemma 3 1B better than Qwen Max?

Qwen Max is the stronger model overall, scoring 34.7 to 21.1 on the Noometry Index.

How many benchmarks do Gemma 3 1B and Qwen Max share?

2 benchmarks have published results for both models. Gemma 3 1B has 4 scored results on Noometry and Qwen Max has 23.

Related comparisons

Go deeper