Noometry

Model comparison

Gemma 4 26B A4B IT vs GPT-4.5

Gemma 4 26B A4B IT is the stronger model overall, scoring 43.5 to 37.2 on the Noometry Index.

Last verified . 19 shared benchmarks.

Gemma 4 26B A4B IT Google

43.5

Rank #92 Confirmed

GPT-4.5 OpenAI

37.2

Rank #208 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Gemma 4 26B A4B IT scores higher in 8 categories and GPT-4.5 in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemma 4 26B A4B IT leads 47.6 to 32.6.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 82.2% for Gemma 4 26B A4B IT and 37.8% for GPT-4.5.
  • Gemma 4 26B A4B IT has downloadable open weights; the other is API-only.

Side by side

Gemma 4 26B A4B ITGPT-4.5
ProviderGoogleOpenAI
Noometry Index43.537.2
Released2026-04-022025-02-27
WeightsOpenProprietary
Context window262K—
Max output33K—
Input $ / M tokens$0.0675—
Output $ / M tokens$0.23—
Results tracked2842

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-4.5 leads

Gemma 4 26B A4B IT: 39.0 (#164), GPT-4.5: 42.2 (#109)

BenchmarkGemma 4 26B A4B ITGPT-4.5
WeirdML35.2%39.4%
LMArena Coding14471396
Aider Polyglot—44.9%
LMArena WebDev1359—
SciCode40%—
LiveBench Coding—75.2%
ALE-Bench927.17—

Agentic & Tool Use Not comparable

Gemma 4 26B A4B IT: —, GPT-4.5: 27.9 (#97)

BenchmarkGemma 4 26B A4B ITGPT-4.5
Cybench—17.5%

Reasoning Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 21.8 (#213), GPT-4.5: 13.9 (#330)

BenchmarkGemma 4 26B A4B ITGPT-4.5
LMArena Hard Prompts14391403
Epoch Capabilities Index141.85136.74
ARC-AGI-2—0.8%
SimpleBench—34.5%
ARC-AGI-1—10.3%
CritPt0%—
Chess Puzzles6%—
EnigmaEval—3.2%
LiveBench Reasoning—71.1%
DTBench74.9%—
LiveBench Data Analysis—64.3%
LMCA29.7%—
ForecastBench—61.7
LiveBench—69%

Math Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 47.6 (#67), GPT-4.5: 32.6 (#211)

BenchmarkGemma 4 26B A4B ITGPT-4.5
OTIS Mock AIME 2024-202582.2%37.8%
LMArena Math14701412
LiveBench Math—69.3%
MATH Level 5—78.6%

Knowledge Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 45.7 (#85), GPT-4.5: 32.5 (#211)

BenchmarkGemma 4 26B A4B ITGPT-4.5
GPQA Diamond73.2%68.7%
LMArena Expert14471394
Humanity's Last Exam—5.4%
Confabulations—13.6%
Vectara Hallucination Rate5.2%—

Multimodal Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 40.6 (#46), GPT-4.5: 37.6 (#71)

BenchmarkGemma 4 26B A4B ITGPT-4.5
LMArena Vision12601195
VPCT—45%

Multilingual Too close to call

Gemma 4 26B A4B IT: 53.1 (#71), GPT-4.5: 52.5 (#83)

BenchmarkGemma 4 26B A4B ITGPT-4.5
LMArena Non-English14211413
LMArena Chinese14951421
LMArena French14601418
LMArena Russian14341419
LMArena German—1457
LMArena Japanese—1416
LMArena Korean—1392
LMArena Spanish1417—

Instruction Following Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 74.8 (#82), GPT-4.5: 72.6 (#134)

BenchmarkGemma 4 26B A4B ITGPT-4.5
LMArena Instruction Following14201404
LiveBench Instruction Following—72.3%

Long Context Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 43.6 (#91), GPT-4.5: 40.4 (#155)

BenchmarkGemma 4 26B A4B ITGPT-4.5
LMArena Longer Query14281406
Fiction.LiveBench—63.9%

Writing & Preference Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 58.6 (#115), GPT-4.5: 56.9 (#134)

BenchmarkGemma 4 26B A4B ITGPT-4.5
LMArena Text14341417
LMArena Creative Writing14021394
EQ-Bench Creative Writing13051258
LMArena Multi-Turn14411444
Short-Story Creative Writing—75.6%
LiveBench Language—61.5%

Frequently asked questions

Is Gemma 4 26B A4B IT better than GPT-4.5?

Gemma 4 26B A4B IT is the stronger model overall, scoring 43.5 to 37.2 on the Noometry Index.

Is Gemma 4 26B A4B IT or GPT-4.5 better for coding?

GPT-4.5 scores higher on coding benchmarks: 42.2 versus 39.0 in the Noometry coding category.

How many benchmarks do Gemma 4 26B A4B IT and GPT-4.5 share?

19 benchmarks have published results for both models. Gemma 4 26B A4B IT has 28 scored results on Noometry and GPT-4.5 has 42.

Related comparisons

Go deeper