Model comparison

Gemma 3 1B vs Qwen Plus

Qwen Plus is the stronger model overall, scoring 37.1 to 21.1 on the Noometry Index.

Last verified . 2 shared benchmarks.

Gemma 3 1B Google

21.1

Rank #353 Reported

Qwen Plus Alibaba (Qwen)

37.1

Rank #210 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Gemma 3 1B scores higher in 0 categories and Qwen Plus in 3 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen Plus leads 27.4 to 7.0.
  • The biggest single-benchmark swing is GPQA Diamond: 19.9% for Gemma 3 1B and 48.1% for Qwen Plus.
  • Gemma 3 1B has downloadable open weights; the other is API-only.

Side by side

Gemma 3 1B and Qwen Plus specifications
Gemma 3 1BQwen Plus
ProviderGoogleAlibaba (Qwen)
Noometry Index21.137.1
Released2025-03-122024-01-25
WeightsOpenProprietary
Context window—1M
Max output—33K
Input $ / M tokens—$0.40
Output $ / M tokens—$1.20
Results tracked420

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Qwen Plus: 38.9 (#167)

Coding benchmarks
BenchmarkGemma 3 1BQwen Plus
LMArena Coding—1328

Agentic & Tool Use Not comparable

Gemma 3 1B: 13.7 (#152), Qwen Plus: —

Agentic & Tool Use benchmarks
BenchmarkGemma 3 1BQwen Plus
Berkeley Function Calling Leaderboard7.2%—

Reasoning Qwen Plus leads

Gemma 3 1B: 19.2 (#264), Qwen Plus: 28.4 (#107)

Reasoning benchmarks
BenchmarkGemma 3 1BQwen Plus
Kagi LLM Benchmark—63.3%
Chess Puzzles0%—
LMArena Hard Prompts—1317
DTBench—81.1%
LMCA—24%

Math Qwen Plus leads

Gemma 3 1B: 10.2 (#316), Qwen Plus: 23.3 (#271)

Math benchmarks
BenchmarkGemma 3 1BQwen Plus
OTIS Mock AIME 2024-20251.1%17.8%
LMArena Math—1326
MATH Level 5—65.3%
FrontierMath (Feb 2025 set)—1.7%

Knowledge Qwen Plus leads

Gemma 3 1B: 7.0 (#314), Qwen Plus: 27.4 (#251)

Knowledge benchmarks
BenchmarkGemma 3 1BQwen Plus
GPQA Diamond19.9%48.1%
LMArena Expert—1328

Multilingual Not comparable

Gemma 3 1B: —, Qwen Plus: 45.1 (#175)

Multilingual benchmarks
BenchmarkGemma 3 1BQwen Plus
LMArena Non-English—1310
LMArena Chinese—1347
LMArena Japanese—1251
LMArena Russian—1323

Instruction Following Not comparable

Gemma 3 1B: —, Qwen Plus: 68.8 (#181)

Instruction Following benchmarks
BenchmarkGemma 3 1BQwen Plus
LMArena Instruction Following—1303

Long Context Not comparable

Gemma 3 1B: —, Qwen Plus: 40.3 (#158)

Long Context benchmarks
BenchmarkGemma 3 1BQwen Plus
LMArena Longer Query—1324

Writing & Preference Not comparable

Gemma 3 1B: —, Qwen Plus: 52.2 (#176)

Writing & Preference benchmarks
BenchmarkGemma 3 1BQwen Plus
LMArena Text—1326
LMArena Creative Writing—1293
LMArena Multi-Turn—1336

Frequently asked questions

Is Gemma 3 1B better than Qwen Plus?

Qwen Plus is the stronger model overall, scoring 37.1 to 21.1 on the Noometry Index.

How many benchmarks do Gemma 3 1B and Qwen Plus share?

2 benchmarks have published results for both models. Gemma 3 1B has 4 scored results on Noometry and Qwen Plus has 20.

Related comparisons

Go deeper