Model comparison

GPT-5.4 Pro vs GPT-5 Nano

GPT-5.4 Pro is the stronger model overall, scoring 58.9 to 33.5 on the Noometry Index. GPT-5 Nano costs 491× less per token, which makes it the better buy when GPT-5.4 Pro's lead doesn't matter for your workload.

Last verified . 12 shared benchmarks.

GPT-5.4 Pro OpenAI

58.9

Rank #18 Confirmed

GPT-5 Nano OpenAI

33.5

Rank #241 Confirmed

Summary

  • They share 12 benchmarks with published results for both. GPT-5.4 Pro scores higher in 4 categories and GPT-5 Nano in 0 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GPT-5.4 Pro leads 70.7 to 16.3.
  • The biggest single-benchmark swing is ARC-AGI-2: 83.3% for GPT-5.4 Pro and 2.6% for GPT-5 Nano.
  • GPT-5 Nano is cheaper at $0.05 / $0.40 per million input/output tokens, against $30 / $180 for GPT-5.4 Pro.
  • GPT-5.4 Pro accepts more context: 1.05M tokens versus 400K.

Side by side

GPT-5.4 Pro and GPT-5 Nano specifications
GPT-5.4 ProGPT-5 Nano
ProviderOpenAIOpenAI
Noometry Index58.933.5
Released2026-03-052025-08-07
WeightsProprietaryProprietary
Context window1.05M400K
Max output128K128K
Input $ / M tokens$30$0.05
Output $ / M tokens$180$0.40
Results tracked1649

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.4 Pro leads

GPT-5.4 Pro: 43.2 (#90), GPT-5 Nano: 33.6 (#254)

Coding benchmarks
BenchmarkGPT-5.4 ProGPT-5 Nano
WeirdML57.4%38.1%
SWE-bench Verified (bash only)—34.8%
LMArena Coding—1351
ALE-Bench—718.67

Agentic & Tool Use Not comparable

GPT-5.4 Pro: —, GPT-5 Nano: 25.8 (#106)

Agentic & Tool Use benchmarks
BenchmarkGPT-5.4 ProGPT-5 Nano
Terminal-Bench—21.8%
Berkeley Function Calling Leaderboard—51.5%

Reasoning GPT-5.4 Pro leads

GPT-5.4 Pro: 70.7 (#13), GPT-5 Nano: 16.3 (#306)

Reasoning benchmarks
BenchmarkGPT-5.4 ProGPT-5 Nano
ARC-AGI-283.3%2.6%
ARC-AGI-194.5%20.7%
Chess Puzzles58.6%27%
Epoch Capabilities Index158.93139.38
SimpleBench74.1%—
Kagi LLM Benchmark—62.2%
CritPt30%—
EnigmaEval23.8%—
LMArena Hard Prompts—1328
Mystery Game Puzzles—9%
DTBench—62.7%
LMCA—7.9%
ForecastBench—59.1

Math GPT-5.4 Pro leads

GPT-5.4 Pro: 72.4 (#22), GPT-5 Nano: 29.4 (#241)

Math benchmarks
BenchmarkGPT-5.4 ProGPT-5 Nano
FrontierMath (Tiers 1-3)82.5%20%
FrontierMath Tier 458.5%2.4%
FrontierMath (Feb 2025 set)50%8.3%
FrontierMath Tier 4 (v1)37.5%2.1%
OTIS Mock AIME 2024-2025—81.1%
ProofBench—12%
Omni-MATH—54.6%
LMArena Math—1317
MATH Level 5—95.2%

Knowledge GPT-5.4 Pro leads

GPT-5.4 Pro: 68.3 (#7), GPT-5 Nano: 35.9 (#178)

Knowledge benchmarks
BenchmarkGPT-5.4 ProGPT-5 Nano
GPQA Diamond94.6%69.4%
SimpleQA Verified46.3%11.7%
Vectara Hallucination Rate8.3%10.5%
Humanity's Last Exam44.3%—
MMLU-Pro—77.8%
GPQA (HELM)—67.9%
LMArena Expert—1321

Multimodal Not comparable

GPT-5.4 Pro: —, GPT-5 Nano: 31.3 (#108)

Multimodal benchmarks
BenchmarkGPT-5.4 ProGPT-5 Nano
LMArena Vision—1159
VPCT—37.2%

Multilingual Not comparable

GPT-5.4 Pro: —, GPT-5 Nano: 45.3 (#172)

Multilingual benchmarks
BenchmarkGPT-5.4 ProGPT-5 Nano
LMArena Non-English—1313
LMArena Chinese—1356
LMArena German—1327
LMArena Japanese—1226
LMArena Korean—1269
LMArena Russian—1296
LMArena Spanish—1360

Instruction Following Not comparable

GPT-5.4 Pro: —, GPT-5 Nano: 75.0 (#79)

Instruction Following benchmarks
BenchmarkGPT-5.4 ProGPT-5 Nano
IFEval—93.2%
LMArena Instruction Following—1306

Long Context Not comparable

GPT-5.4 Pro: —, GPT-5 Nano: 31.3 (#281)

Long Context benchmarks
BenchmarkGPT-5.4 ProGPT-5 Nano
Fiction.LiveBench—44.4%
LMArena Longer Query—1312

Writing & Preference Not comparable

GPT-5.4 Pro: —, GPT-5 Nano: 39.1 (#249)

Writing & Preference benchmarks
BenchmarkGPT-5.4 ProGPT-5 Nano
LMArena Text—1320
LMArena Creative Writing—1249
EQ-Bench Creative Writing—705
WildBench—80.6%
LMArena Multi-Turn—1311

Frequently asked questions

Is GPT-5.4 Pro better than GPT-5 Nano?

GPT-5.4 Pro is the stronger model overall, scoring 58.9 to 33.5 on the Noometry Index. GPT-5 Nano costs 491× less per token, which makes it the better buy when GPT-5.4 Pro's lead doesn't matter for your workload.

Which is cheaper, GPT-5.4 Pro or GPT-5 Nano?

GPT-5 Nano is cheaper. It lists at $0.05 per million input tokens and $0.40 per million output tokens; GPT-5.4 Pro lists at $30 and $180.

Is GPT-5.4 Pro or GPT-5 Nano better for coding?

GPT-5.4 Pro scores higher on coding benchmarks: 43.2 versus 33.6 in the Noometry coding category.

Which has the bigger context window?

GPT-5.4 Pro does, with 1.05M tokens against 400K.

How many benchmarks do GPT-5.4 Pro and GPT-5 Nano share?

12 benchmarks have published results for both models. GPT-5.4 Pro has 16 scored results on Noometry and GPT-5 Nano has 49.

Related comparisons

Go deeper