Model comparison

Gemma 4 26B A4B IT vs Qwen3-4B

Gemma 4 26B A4B IT is the stronger model overall, scoring 43.1 to 31.5 on the Noometry Index.

Last verified October 10, 2026. 4 shared benchmarks.

Gemma 4 26B A4B IT

Google

43.1

Rank #88 Confirmed

Qwen3-4B

Alibaba (Qwen)

31.5

Rank #261 Confirmed

Summary

They share 4 benchmarks with published results for both. Gemma 4 26B A4B IT scores higher in 3 categories and Qwen3-4B in 0 categories; 3 gaps are clear of the uncertainty.
The widest gap is in math, where Gemma 4 26B A4B IT leads 45.7 to 28.5.
The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 82.2% for Gemma 4 26B A4B IT and 52.2% for Qwen3-4B.

Side by side

Gemma 4 26B A4B IT and Qwen3-4B specifications
	Gemma 4 26B A4B IT	Qwen3-4B
Provider	Google	Alibaba (Qwen)
Noometry Index	43.1	31.5
Released	2026-04-02	2025-04-29
Weights	Open	Open
Context window	262K	—
Max output	33K	—
Input $ / M tokens	$0.0765	—
Output $ / M tokens	$0.26	—
Results tracked	28	6

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 4 26B A4B IT: 38.8 (#156), Qwen3-4B: —

Coding benchmarks
Benchmark	Gemma 4 26B A4B IT	Qwen3-4B
LMArena WebDev	1359	—
SciCode	40%	—
WeirdML	35.2%	—
LMArena Coding	1446	—
ALE-Bench	927.17	—

Agentic & Tool Use Not comparable

Gemma 4 26B A4B IT: —, Qwen3-4B: 27.3 (#94)

Agentic & Tool Use benchmarks
Benchmark	Gemma 4 26B A4B IT	Qwen3-4B
Berkeley Function Calling Leaderboard	—	35.7%

Reasoning Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 21.1 (#205), Qwen3-4B: 18.5 (#264)

Reasoning benchmarks
Benchmark	Gemma 4 26B A4B IT	Qwen3-4B
Chess Puzzles	6%	4%
CritPt	0%	—
LMArena Hard Prompts	1438	—
DTBench	74.9%	—
LMCA	29.7%	—
Epoch Capabilities Index	141.85	—

Math Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 45.7 (#61), Qwen3-4B: 28.5 (#228)

Math benchmarks
Benchmark	Gemma 4 26B A4B IT	Qwen3-4B
OTIS Mock AIME 2024-2025	82.2%	52.2%
MathArena Final-Answer Competitions	—	38.5%
LMArena Math	1469	—

Knowledge Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 45.6 (#79), Qwen3-4B: 33.0 (#198)

Knowledge benchmarks
Benchmark	Gemma 4 26B A4B IT	Qwen3-4B
GPQA Diamond	73.2%	52.3%
Vectara Hallucination Rate	5.2%	5.7%
LMArena Expert	1447	—

Multimodal Not comparable

Gemma 4 26B A4B IT: 39.9 (#43), Qwen3-4B: —

Multimodal benchmarks
Benchmark	Gemma 4 26B A4B IT	Qwen3-4B
LMArena Vision	1260	—

Multilingual Not comparable

Gemma 4 26B A4B IT: 53.3 (#68), Qwen3-4B: —

Multilingual benchmarks
Benchmark	Gemma 4 26B A4B IT	Qwen3-4B
LMArena Non-English	1422	—
LMArena Chinese	1495	—
LMArena French	1459	—
LMArena Russian	1434	—
LMArena Spanish	1415	—

Instruction Following Not comparable

Gemma 4 26B A4B IT: 75.0 (#78), Qwen3-4B: —

Instruction Following benchmarks
Benchmark	Gemma 4 26B A4B IT	Qwen3-4B
LMArena Instruction Following	1420	—

Long Context Not comparable

Gemma 4 26B A4B IT: 43.6 (#87), Qwen3-4B: —

Long Context benchmarks
Benchmark	Gemma 4 26B A4B IT	Qwen3-4B
LMArena Longer Query	1427	—

Writing & Preference Not comparable

Gemma 4 26B A4B IT: 58.8 (#110), Qwen3-4B: —

Writing & Preference benchmarks
Benchmark	Gemma 4 26B A4B IT	Qwen3-4B
LMArena Text	1434	—
LMArena Creative Writing	1401	—
EQ-Bench Creative Writing	1305	—
LMArena Multi-Turn	1442	—

Frequently asked questions

Is Gemma 4 26B A4B IT better than Qwen3-4B?