Model comparison

Gemma 4 31B IT vs Qwen3-1.7B

Gemma 4 31B IT is the stronger model overall, scoring 43.5 to 26.6 on the Noometry Index.

Last verified October 10, 2026. 3 shared benchmarks.

Gemma 4 31B IT

Google

43.5

Rank #90 Confirmed

Qwen3-1.7B

Alibaba (Qwen)

26.6

Rank #336 Reported

Summary

They share 3 benchmarks with published results for both. Gemma 4 31B IT scores higher in 3 categories and Qwen3-1.7B in 0 categories; 3 gaps are clear of the uncertainty.
The widest gap is in math, where Gemma 4 31B IT leads 43.2 to 16.3.
The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 73.3% for Gemma 4 31B IT and 8.1% for Qwen3-1.7B.

Side by side

Gemma 4 31B IT and Qwen3-1.7B specifications
	Gemma 4 31B IT	Qwen3-1.7B
Provider	Google	Alibaba (Qwen)
Noometry Index	43.5	26.6
Released	2026-04-02	2025-04-29
Weights	Open	Open
Context window	262K	—
Max output	33K	—
Input $ / M tokens	$0.09	—
Output $ / M tokens	$0.34	—
Results tracked	35	4

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 4 31B IT: 42.3 (#108), Qwen3-1.7B: —

Coding benchmarks
Benchmark	Gemma 4 31B IT	Qwen3-1.7B
LMArena WebDev	1366	—
SciCode	43.4%	—
WeirdML	52.3%	—
LMArena Coding	1459	—
ALE-Bench	925.5	—

Agentic & Tool Use Not comparable

Gemma 4 31B IT: —, Qwen3-1.7B: 24.7 (#115)

Agentic & Tool Use benchmarks
Benchmark	Gemma 4 31B IT	Qwen3-1.7B
Berkeley Function Calling Leaderboard	—	28.4%

Reasoning Gemma 4 31B IT leads

Gemma 4 31B IT: 27.2 (#122), Qwen3-1.7B: 19.2 (#267)

Reasoning benchmarks
Benchmark	Gemma 4 31B IT	Qwen3-1.7B
Chess Puzzles	5%	0%
Kagi LLM Benchmark	63.5%	—
NYT Connections (extended)	70.6%	—
CritPt	1.4%	—
Thematic Generalization	53%	—
LMArena Hard Prompts	1448	—
DTBench	82.7%	—
LMCA	39.3%	—
Surface Evolver Bench	30.6%	—
Epoch Capabilities Index	142.74	—

Math Gemma 4 31B IT leads

Gemma 4 31B IT: 43.2 (#81), Qwen3-1.7B: 16.3 (#294)

Math benchmarks
Benchmark	Gemma 4 31B IT	Qwen3-1.7B
OTIS Mock AIME 2024-2025	73.3%	8.1%
LMArena Math	1465	—

Knowledge Gemma 4 31B IT leads

Gemma 4 31B IT: 37.9 (#151), Qwen3-1.7B: 19.6 (#278)

Knowledge benchmarks
Benchmark	Gemma 4 31B IT	Qwen3-1.7B
GPQA Diamond	75.8%	38%
SimpleQA Verified	10.4%	—
Vectara Hallucination Rate	7.4%	—
LMArena Expert	1465	—

Multimodal Not comparable

Gemma 4 31B IT: 41.6 (#34), Qwen3-1.7B: —

Multimodal benchmarks
Benchmark	Gemma 4 31B IT	Qwen3-1.7B
LMArena Vision	1277	—
LMArena Document	1425	—

Multilingual Not comparable

Gemma 4 31B IT: 53.8 (#57), Qwen3-1.7B: —

Multilingual benchmarks
Benchmark	Gemma 4 31B IT	Qwen3-1.7B
LMArena Non-English	1431	—
LMArena Chinese	1476	—
LMArena French	1435	—
LMArena Russian	1460	—
LMArena Spanish	1444	—

Instruction Following Not comparable

Gemma 4 31B IT: 75.5 (#61), Qwen3-1.7B: —

Instruction Following benchmarks
Benchmark	Gemma 4 31B IT	Qwen3-1.7B
LMArena Instruction Following	1433	—

Long Context Not comparable

Gemma 4 31B IT: 44.2 (#71), Qwen3-1.7B: —

Long Context benchmarks
Benchmark	Gemma 4 31B IT	Qwen3-1.7B
LMArena Longer Query	1446	—

Writing & Preference Not comparable

Gemma 4 31B IT: 60.5 (#96), Qwen3-1.7B: —

Writing & Preference benchmarks
Benchmark	Gemma 4 31B IT	Qwen3-1.7B
LMArena Text	1443	—
LMArena Creative Writing	1415	—
EQ-Bench Creative Writing	1368	—
EQ-Bench 4	1120	—
LMArena Multi-Turn	1452	—

Frequently asked questions

Is Gemma 4 31B IT better than Qwen3-1.7B?