Noometry

Model comparison

Gemma 3 1B vs Qwen3 235B-A22B

Qwen3 235B-A22B is the stronger model overall, scoring 43.2 to 20.7 on the Noometry Index.

Last verified . 4 shared benchmarks.

Gemma 3 1B Google

20.7

Rank #348 Reported

Qwen3 235B-A22B Alibaba (Qwen)

43.2

Rank #83 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Gemma 3 1B scores higher in 1 category and Qwen3 235B-A22B in 3 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3 235B-A22B leads 49.5 to 7.1.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.1% for Gemma 3 1B and 86.7% for Qwen3 235B-A22B.

Side by side

Gemma 3 1BQwen3 235B-A22B
ProviderGoogleAlibaba (Qwen)
Noometry Index20.743.2
Released2025-03-122025-04
WeightsOpenOpen
Context window—131K
Max output—16K
Input $ / M tokens—$0.70
Output $ / M tokens—$2.80
Results tracked449

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Qwen3 235B-A22B: 43.8 (#72)

BenchmarkGemma 3 1BQwen3 235B-A22B
Aider Polyglot—59.6%
SciCode—42.4%
WeirdML—41%
LMArena Coding—1445

Agentic & Tool Use Qwen3 235B-A22B leads

Gemma 3 1B: 13.5 (#144), Qwen3 235B-A22B: 33.7 (#48)

BenchmarkGemma 3 1BQwen3 235B-A22B
Berkeley Function Calling Leaderboard7.2%52.1%
Vending-Bench 2—-11.34

Reasoning Gemma 3 1B leads

Gemma 3 1B: 18.5 (#260), Qwen3 235B-A22B: 15.8 (#302)

BenchmarkGemma 3 1BQwen3 235B-A22B
Chess Puzzles0%12%
ARC-AGI-2—1.3%
SimpleBench—31%
Kagi LLM Benchmark—69.4%
ARC-AGI-1—11%
CritPt—0%
LMArena Hard Prompts—1433
Mystery Game Puzzles—9%
DTBench—80.3%
LMCA—29.3%
Epoch Capabilities Index—143.87
ForecastBench—59.7

Math Qwen3 235B-A22B leads

Gemma 3 1B: 9.6 (#310), Qwen3 235B-A22B: 48.5 (#51)

BenchmarkGemma 3 1BQwen3 235B-A22B
OTIS Mock AIME 2024-20251.1%86.7%
Omni-MATH—71.8%
LMArena Math—1431
MATH Level 5—68.9%
FrontierMath (Feb 2025 set)—8.5%
FrontierMath Tier 4 (v1)—0%

Knowledge Qwen3 235B-A22B leads

Gemma 3 1B: 7.1 (#309), Qwen3 235B-A22B: 49.5 (#67)

BenchmarkGemma 3 1BQwen3 235B-A22B
GPQA Diamond19.9%80.1%
SimpleQA Verified—40.4%
MMLU-Pro—84.4%
Confabulations—15.6%
Vectara Hallucination Rate—9.3%
GPQA (HELM)—72.7%
LMArena Expert—1460

Multilingual Not comparable

Gemma 3 1B: —, Qwen3 235B-A22B: 52.5 (#84)

BenchmarkGemma 3 1BQwen3 235B-A22B
LMArena Non-English—1410
LMArena Chinese—1481
LMArena French—1445
LMArena German—1432
LMArena Japanese—1400
LMArena Korean—1391
LMArena Russian—1411
LMArena Spanish—1429

Instruction Following Not comparable

Gemma 3 1B: —, Qwen3 235B-A22B: 72.8 (#132)

BenchmarkGemma 3 1BQwen3 235B-A22B
IFEval—83.5%
LMArena Instruction Following—1408

Long Context Not comparable

Gemma 3 1B: —, Qwen3 235B-A22B: 46.1 (#25)

BenchmarkGemma 3 1BQwen3 235B-A22B
Fiction.LiveBench—75%
LMArena Longer Query—1426

Writing & Preference Not comparable

Gemma 3 1B: —, Qwen3 235B-A22B: 59.8 (#103)

BenchmarkGemma 3 1BQwen3 235B-A22B
LMArena Text—1419
LMArena Creative Writing—1384
Short-Story Creative Writing—83%
EQ-Bench Creative Writing—1366
WildBench—86.6%
LMArena Multi-Turn—1432

Frequently asked questions

Is Gemma 3 1B better than Qwen3 235B-A22B?

Qwen3 235B-A22B is the stronger model overall, scoring 43.2 to 20.7 on the Noometry Index.

How many benchmarks do Gemma 3 1B and Qwen3 235B-A22B share?

4 benchmarks have published results for both models. Gemma 3 1B has 4 scored results on Noometry and Qwen3 235B-A22B has 49.

Related comparisons

Go deeper