Noometry

Model comparison

Gemma 3n E4b IT vs Grok 4.5

Grok 4.5 is the stronger model overall, scoring 55.0 to 37.3 on the Noometry Index.

Last verified . 18 shared benchmarks.

Gemma 3n E4b IT Google

37.3

Rank #206 Confirmed

Grok 4.5 xAI

55.0

Rank #25 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Gemma 3n E4b IT scores higher in 0 categories and Grok 4.5 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.5 leads 56.1 to 19.9.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 31.5% for Gemma 3n E4b IT and 83.5% for Grok 4.5.
  • Gemma 3n E4b IT has downloadable open weights; the other is API-only.

Side by side

Gemma 3n E4b ITGrok 4.5
ProviderGooglexAI
Noometry Index37.355.0
Released—2026-07-08
WeightsOpenProprietary
Context window—500K
Max output—500K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked1852

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.5 leads

Gemma 3n E4b IT: 37.0 (#198), Grok 4.5: 52.2 (#35)

BenchmarkGemma 3n E4b ITGrok 4.5
LMArena Coding12681474
DeepSWE—53.8%
FrontierCode—42.4%
LMArena WebDev—1553
SciCode—54.1%
WeirdML—46.4%
ALE-Bench—1,309

Agentic & Tool Use Not comparable

Gemma 3n E4b IT: —, Grok 4.5: 44.4 (#17)

BenchmarkGemma 3n E4b ITGrok 4.5
APEX-Agents—56.2%
τ²-bench Banking—47.9%
PostTrainBench—23.4%
GBAEval—65.4%
GDP.pdf—14%
LMArena Search—1213
Vending-Bench 2—3,887

Reasoning Grok 4.5 leads

Gemma 3n E4b IT: 19.9 (#247), Grok 4.5: 56.1 (#25)

BenchmarkGemma 3n E4b ITGrok 4.5
Kagi LLM Benchmark31.5%83.5%
LMArena Hard Prompts12841462
ARC-AGI-2—52.6%
SimpleBench—70%
NYT Connections (extended)—79.9%
ARC-AGI-1—87.2%
CritPt—15.4%
Chess Puzzles—36%
DTBench—96.5%
LMCA—45.2%
Surface Evolver Bench—74.4%
Epoch Capabilities Index—153.92

Math Grok 4.5 leads

Gemma 3n E4b IT: 35.1 (#188), Grok 4.5: 60.9 (#35)

BenchmarkGemma 3n E4b ITGrok 4.5
LMArena Math12511459
FrontierMath (Tiers 1-3)—57.2%
FrontierMath Tier 4—24.4%
OTIS Mock AIME 2024-2025—97.8%
ProofBench—31%

Knowledge Grok 4.5 leads

Gemma 3n E4b IT: 34.2 (#198), Grok 4.5: 62.3 (#24)

BenchmarkGemma 3n E4b ITGrok 4.5
LMArena Expert12461466
GPQA Diamond—93.4%
SimpleQA Verified—48.3%

Multimodal Not comparable

Gemma 3n E4b IT: —, Grok 4.5: 37.6 (#72)

BenchmarkGemma 3n E4b ITGrok 4.5
LMArena Vision—1288
Blueprint-Bench 2—27.3%
Furniture Assembly—22.5%
LMArena Document—1452

Multilingual Grok 4.5 leads

Gemma 3n E4b IT: 43.4 (#183), Grok 4.5: 54.4 (#42)

BenchmarkGemma 3n E4b ITGrok 4.5
LMArena Non-English12851440
LMArena Chinese13091496
LMArena French13301456
LMArena German13111446
LMArena Japanese12721428
LMArena Korean12591404
LMArena Russian12881448
LMArena Spanish13051450

Instruction Following Grok 4.5 leads

Gemma 3n E4b IT: 66.1 (#210), Grok 4.5: 76.0 (#48)

BenchmarkGemma 3n E4b ITGrok 4.5
LMArena Instruction Following12551446

Long Context Grok 4.5 leads

Gemma 3n E4b IT: 38.7 (#191), Grok 4.5: 44.8 (#56)

BenchmarkGemma 3n E4b ITGrok 4.5
LMArena Longer Query12761463

Writing & Preference Grok 4.5 leads

Gemma 3n E4b IT: 50.1 (#186), Grok 4.5: 65.8 (#42)

BenchmarkGemma 3n E4b ITGrok 4.5
LMArena Text13061448
LMArena Creative Writing12871442
LMArena Multi-Turn12761456
EQ-Bench Creative Writing—1579

Frequently asked questions

Is Gemma 3n E4b IT better than Grok 4.5?

Grok 4.5 is the stronger model overall, scoring 55.0 to 37.3 on the Noometry Index.

Is Gemma 3n E4b IT or Grok 4.5 better for coding?

Grok 4.5 scores higher on coding benchmarks: 52.2 versus 37.0 in the Noometry coding category.

How many benchmarks do Gemma 3n E4b IT and Grok 4.5 share?

18 benchmarks have published results for both models. Gemma 3n E4b IT has 18 scored results on Noometry and Grok 4.5 has 52.

Related comparisons

Go deeper