Noometry

Model comparison

Gemma 4 26B A4B IT vs Qwen2.5-Max

Gemma 4 26B A4B IT is the stronger model overall, scoring 43.5 to 40.7 on the Noometry Index.

Last verified . 15 shared benchmarks.

Gemma 4 26B A4B IT Google

43.5

Rank #92 Confirmed

Qwen2.5-Max Alibaba (Qwen)

40.7

Rank #146 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Gemma 4 26B A4B IT scores higher in 6 categories and Qwen2.5-Max in 2 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemma 4 26B A4B IT leads 47.6 to 36.9.
  • Gemma 4 26B A4B IT has downloadable open weights; the other is API-only.

Side by side

Gemma 4 26B A4B ITQwen2.5-Max
ProviderGoogleAlibaba (Qwen)
Noometry Index43.540.7
Released2026-04-022025-01-25
WeightsOpenProprietary
Context window262K—
Max output33K—
Input $ / M tokens$0.0675—
Output $ / M tokens$0.23—
Results tracked2827

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen2.5-Max leads

Gemma 4 26B A4B IT: 39.0 (#164), Qwen2.5-Max: 41.8 (#117)

BenchmarkGemma 4 26B A4B ITQwen2.5-Max
LMArena Coding14471359
LMArena WebDev1359—
SciCode40%—
WeirdML35.2%—
LiveBench Coding—64.4%
ALE-Bench927.17—

Reasoning Qwen2.5-Max leads

Gemma 4 26B A4B IT: 21.8 (#213), Qwen2.5-Max: 25.6 (#147)

BenchmarkGemma 4 26B A4B ITQwen2.5-Max
LMArena Hard Prompts14391360
Epoch Capabilities Index141.85132.53
CritPt0%—
Chess Puzzles6%—
LiveBench Reasoning—51.4%
DTBench74.9%—
LiveBench Data Analysis—67.9%
LMCA29.7%—
LiveBench—62.3%

Math Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 47.6 (#67), Qwen2.5-Max: 36.9 (#162)

BenchmarkGemma 4 26B A4B ITQwen2.5-Max
LMArena Math14701369
OTIS Mock AIME 2024-202582.2%—
LiveBench Math—58.4%

Knowledge Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 45.7 (#85), Qwen2.5-Max: 35.3 (#186)

BenchmarkGemma 4 26B A4B ITQwen2.5-Max
LMArena Expert14471337
GPQA Diamond73.2%—
Confabulations—21.8%
Vectara Hallucination Rate5.2%—

Multimodal Not comparable

Gemma 4 26B A4B IT: 40.6 (#46), Qwen2.5-Max: —

BenchmarkGemma 4 26B A4B ITQwen2.5-Max
LMArena Vision1260—

Multilingual Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 53.1 (#71), Qwen2.5-Max: 48.1 (#146)

BenchmarkGemma 4 26B A4B ITQwen2.5-Max
LMArena Non-English14211352
LMArena Chinese14951382
LMArena French14601396
LMArena Russian14341353
LMArena Spanish14171377
LMArena German—1350
LMArena Japanese—1300
LMArena Korean—1304

Instruction Following Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 74.8 (#82), Qwen2.5-Max: 71.3 (#152)

BenchmarkGemma 4 26B A4B ITQwen2.5-Max
LMArena Instruction Following14201335
LiveBench Instruction Following—75.3%

Long Context Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 43.6 (#91), Qwen2.5-Max: 41.4 (#142)

BenchmarkGemma 4 26B A4B ITQwen2.5-Max
LMArena Longer Query14281358

Writing & Preference Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 58.6 (#115), Qwen2.5-Max: 55.4 (#146)

BenchmarkGemma 4 26B A4B ITQwen2.5-Max
LMArena Text14341367
LMArena Creative Writing14021339
LMArena Multi-Turn14411364
Short-Story Creative Writing—72.9%
EQ-Bench Creative Writing1305—
LiveBench Language—56.3%

Frequently asked questions

Is Gemma 4 26B A4B IT better than Qwen2.5-Max?

Gemma 4 26B A4B IT is the stronger model overall, scoring 43.5 to 40.7 on the Noometry Index.

Is Gemma 4 26B A4B IT or Qwen2.5-Max better for coding?

Qwen2.5-Max scores higher on coding benchmarks: 41.8 versus 39.0 in the Noometry coding category.

How many benchmarks do Gemma 4 26B A4B IT and Qwen2.5-Max share?

15 benchmarks have published results for both models. Gemma 4 26B A4B IT has 28 scored results on Noometry and Qwen2.5-Max has 27.

Related comparisons

Go deeper