Model comparison

Gemma 3n E4b IT vs GPT-5.4 Pro

GPT-5.4 Pro is the stronger model overall, scoring 58.8 to 36.7 on the Noometry Index. Gemma 3n E4b IT costs 900× less per token, which makes it the better buy when GPT-5.4 Pro's lead doesn't matter for your workload.

Last verified October 10, 2026. 0 shared benchmarks.

Gemma 3n E4b IT

Google

36.7

Rank #203 Confirmed

GPT-5.4 Pro OpenAI

58.8

Rank #16 Confirmed

Summary

The widest gap is in reasoning, where GPT-5.4 Pro leads 71.0 to 19.2.
Gemma 3n E4b IT is cheaper at $0.06 / $0.12 per million input/output tokens, against $30 / $180 for GPT-5.4 Pro.
GPT-5.4 Pro accepts more context: 1.05M tokens versus 33K.
Gemma 3n E4b IT has downloadable open weights; the other is API-only.

Side by side

Gemma 3n E4b IT and GPT-5.4 Pro specifications
	Gemma 3n E4b IT	GPT-5.4 Pro
Provider	Google	OpenAI
Noometry Index	36.7	58.8
Released	2025-05-20	2026-03-05
Weights	Open	Proprietary
Context window	33K	1.05M
Max output	33K	128K
Input $ / M tokens	$0.06	$30
Output $ / M tokens	$0.12	$180
Results tracked	18	16

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.4 Pro leads

Gemma 3n E4b IT: 36.4 (#193), GPT-5.4 Pro: 42.6 (#89)

Coding benchmarks
Benchmark	Gemma 3n E4b IT	GPT-5.4 Pro
WeirdML	—	57.4%
LMArena Coding	1269	—

Reasoning GPT-5.4 Pro leads

Gemma 3n E4b IT: 19.2 (#239), GPT-5.4 Pro: 71.0 (#10)

Reasoning benchmarks
Benchmark	Gemma 3n E4b IT	GPT-5.4 Pro
ARC-AGI-2	—	83.3%
SimpleBench	—	74.1%
Kagi LLM Benchmark	31.5%	—
ARC-AGI-1	—	94.5%
CritPt	—	30%
Chess Puzzles	—	58.6%
EnigmaEval	—	23.8%
LMArena Hard Prompts	1284	—
Epoch Capabilities Index	—	159.12

Math GPT-5.4 Pro leads

Gemma 3n E4b IT: 32.5 (#186), GPT-5.4 Pro: 72.0 (#17)

Math benchmarks
Benchmark	Gemma 3n E4b IT	GPT-5.4 Pro
FrontierMath (Tiers 1-3)	—	82.5%
FrontierMath Tier 4	—	58.5%
LMArena Math	1251	—
FrontierMath (Feb 2025 set)	—	50%
FrontierMath Tier 4 (v1)	—	37.5%

Knowledge GPT-5.4 Pro leads

Gemma 3n E4b IT: 33.6 (#193), GPT-5.4 Pro: 68.3 (#6)

Knowledge benchmarks
Benchmark	Gemma 3n E4b IT	GPT-5.4 Pro
GPQA Diamond	—	94.6%
Humanity's Last Exam	—	44.3%
SimpleQA Verified	—	46.3%
Vectara Hallucination Rate	—	8.3%
LMArena Expert	1245	—

Multilingual Not comparable

Gemma 3n E4b IT: 43.5 (#179), GPT-5.4 Pro: —

Multilingual benchmarks
Benchmark	Gemma 3n E4b IT	GPT-5.4 Pro
LMArena Non-English	1285	—
LMArena Chinese	1310	—
LMArena French	1330	—
LMArena German	1312	—
LMArena Japanese	1274	—
LMArena Korean	1259	—
LMArena Russian	1288	—
LMArena Spanish	1305	—

Instruction Following Not comparable

Gemma 3n E4b IT: 66.3 (#205), GPT-5.4 Pro: —

Instruction Following benchmarks
Benchmark	Gemma 3n E4b IT	GPT-5.4 Pro
LMArena Instruction Following	1255	—

Long Context Not comparable

Gemma 3n E4b IT: 38.8 (#185), GPT-5.4 Pro: —

Long Context benchmarks
Benchmark	Gemma 3n E4b IT	GPT-5.4 Pro
LMArena Longer Query	1277	—

Writing & Preference Not comparable

Gemma 3n E4b IT: 50.3 (#181), GPT-5.4 Pro: —

Writing & Preference benchmarks
Benchmark	Gemma 3n E4b IT	GPT-5.4 Pro
LMArena Text	1306	—
LMArena Creative Writing	1287	—
LMArena Multi-Turn	1276	—

Frequently asked questions

Is Gemma 3n E4b IT better than GPT-5.4 Pro?

Which is cheaper, Gemma 3n E4b IT or GPT-5.4 Pro?

Gemma 3n E4b IT is cheaper. It lists at $0.06 per million input tokens and $0.12 per million output tokens; GPT-5.4 Pro lists at $30 and $180.

Is Gemma 3n E4b IT or GPT-5.4 Pro better for coding?

GPT-5.4 Pro scores higher on coding benchmarks: 42.6 versus 36.4 in the Noometry coding category.

Which has the bigger context window?

GPT-5.4 Pro does, with 1.05M tokens against 33K.

How many benchmarks do Gemma 3n E4b IT and GPT-5.4 Pro share?

0 benchmarks have published results for both models. Gemma 3n E4b IT has 18 scored results on Noometry and GPT-5.4 Pro has 16.