Model comparison

Gemma 3 27B vs Qwen2.5-Coder (1.5B)

Gemma 3 27B has enough public results to be ranked (#277); Qwen2.5-Coder (1.5B) does not yet, so treat this comparison as directional.

Last verified October 10, 2026. 1 shared benchmarks.

Gemma 3 27B

Google

30.5

Rank #277 Confirmed

Qwen2.5-Coder (1.5B)

Alibaba (Qwen)

—

Unranked

Summary

They share 1 benchmark with published results for both.

Side by side

Gemma 3 27B and Qwen2.5-Coder (1.5B) specifications
	Gemma 3 27B	Qwen2.5-Coder (1.5B)
Provider	Google	Alibaba (Qwen)
Noometry Index	30.5	—
Released	2025-03-11	2024-09-18
Weights	Open	Open
Context window	131K	—
Max output	8K	—
Input $ / M tokens	$0.08	—
Output $ / M tokens	$0.16	—
Results tracked	43	6

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 27B: 22.1 (#329), Qwen2.5-Coder (1.5B): —

Coding benchmarks
Benchmark	Gemma 3 27B	Qwen2.5-Coder (1.5B)
Aider Polyglot	4.9%	—
SciCode	21.2%	—
LiveBench Coding	39.9%	—
LMArena Coding	1322	—

Agentic & Tool Use Not comparable

Gemma 3 27B: 24.9 (#105), Qwen2.5-Coder (1.5B): —

Agentic & Tool Use benchmarks
Benchmark	Gemma 3 27B	Qwen2.5-Coder (1.5B)
Berkeley Function Calling Leaderboard	29.5%	—

Reasoning Not comparable

Gemma 3 27B: 16.3 (#297), Qwen2.5-Coder (1.5B): —

Reasoning benchmarks
Benchmark	Gemma 3 27B	Qwen2.5-Coder (1.5B)
Epoch Capabilities Index	130.04	112.93
Kagi LLM Benchmark	40.4%	—
CritPt	0%	—
Chess Puzzles	0%	—
LiveBench Reasoning	43.8%	—
LMArena Hard Prompts	1340	—
DTBench	52.5%	—
LiveBench Data Analysis	51.5%	—
LMCA	12.3%	—
HellaSwag	—	76.8%
LiveBench	50%	—
WinoGrande	—	72.9%

Math Not comparable

Gemma 3 27B: 24.4 (#261), Qwen2.5-Coder (1.5B): —

Math benchmarks
Benchmark	Gemma 3 27B	Qwen2.5-Coder (1.5B)
OTIS Mock AIME 2024-2025	22.5%	—
LiveBench Math	55.4%	—
LMArena Math	1312	—
MATH Level 5	74%	—
GSM8K	—	86.7%

Knowledge Not comparable

Gemma 3 27B: 25.4 (#256), Qwen2.5-Coder (1.5B): —

Knowledge benchmarks
Benchmark	Gemma 3 27B	Qwen2.5-Coder (1.5B)
GPQA Diamond	47.7%	—
Confabulations	40.3%	—
Vectara Hallucination Rate	7.4%	—
LMArena Expert	1303	—
ARC (AI2) Challenge	—	60.9%
MMLU	—	68%

Multimodal Not comparable

Gemma 3 27B: 32.0 (#94), Qwen2.5-Coder (1.5B): —

Multimodal benchmarks
Benchmark	Gemma 3 27B	Qwen2.5-Coder (1.5B)
LMArena Vision	1165	—
GeoBench	52%	—

Multilingual Not comparable

Gemma 3 27B: 47.0 (#150), Qwen2.5-Coder (1.5B): —

Multilingual benchmarks
Benchmark	Gemma 3 27B	Qwen2.5-Coder (1.5B)
LMArena Non-English	1334	—
LMArena Chinese	1347	—
LMArena French	1368	—
LMArena German	1362	—
LMArena Japanese	1287	—
LMArena Korean	1308	—
LMArena Russian	1349	—
LMArena Spanish	1348	—

Instruction Following Not comparable

Gemma 3 27B: 70.8 (#155), Qwen2.5-Coder (1.5B): —

Instruction Following benchmarks
Benchmark	Gemma 3 27B	Qwen2.5-Coder (1.5B)
LiveBench Instruction Following	74.9%	—
LMArena Instruction Following	1321	—

Long Context Not comparable

Gemma 3 27B: 27.6 (#288), Qwen2.5-Coder (1.5B): —

Long Context benchmarks
Benchmark	Gemma 3 27B	Qwen2.5-Coder (1.5B)
Fiction.LiveBench	33.3%	—
LMArena Longer Query	1333	—

Writing & Preference Not comparable

Gemma 3 27B: 52.7 (#161), Qwen2.5-Coder (1.5B): —

Writing & Preference benchmarks
Benchmark	Gemma 3 27B	Qwen2.5-Coder (1.5B)
LMArena Text	1358	—
LMArena Creative Writing	1346	—
Short-Story Creative Writing	79.9%	—
EQ-Bench Creative Writing	1266	—
LMArena Multi-Turn	1344	—
LiveBench Language	34.6%	—

Frequently asked questions

Is Gemma 3 27B better than Qwen2.5-Coder (1.5B)?