Noometry

Model comparison

GPT-4 Turbo vs GPT-5.4

GPT-5.4 is the stronger model overall, scoring 59.4 to 30.5 on the Noometry Index.

Last verified . 28 shared benchmarks.

GPT-4 Turbo OpenAI

30.5

Rank #292 Confirmed

GPT-5.4 OpenAI

59.4

Rank #16 Confirmed

Summary

  • They share 28 benchmarks with published results for both. GPT-4 Turbo scores higher in 0 categories and GPT-5.4 in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.4 leads 73.5 to 9.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 6.7% for GPT-4 Turbo and 97.8% for GPT-5.4.
  • GPT-5.4 is cheaper at $2.50 / $15 per million input/output tokens, against $10 / $30 for GPT-4 Turbo.
  • GPT-5.4 accepts more context: 1.05M tokens versus 128K.

Side by side

GPT-4 TurboGPT-5.4
ProviderOpenAIOpenAI
Noometry Index30.559.4
Released2023-11-062026-03-05
WeightsProprietaryProprietary
Context window128K1.05M
Max output4K128K
Input $ / M tokens$10$2.50
Output $ / M tokens$30$15
Results tracked3668

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.4 leads

GPT-4 Turbo: 33.8 (#249), GPT-5.4: 52.6 (#33)

BenchmarkGPT-4 TurboGPT-5.4
WeirdML18%77.7%
LMArena Coding12681497
SWE-bench Verified—76.9%
DeepSWE—51.8%
LMArena WebDev—1465
SciCode—56.6%
GSO—31.4%
BigCodeBench Instruct48.2%—
MirrorCode—15.6%
BigCodeBench Complete58.2%—
ALE-Bench—1,607
AlgoTune—1.85
HumanEval+86.6%—
MBPP+73.3%—

Agentic & Tool Use Not comparable

GPT-4 Turbo: —, GPT-5.4: 46.5 (#13)

BenchmarkGPT-4 TurboGPT-5.4
METR Time Horizons36.7%74.3%
Terminal-Bench—81.8%
APEX-Agents—52.4%
τ²-bench Banking—39.4%
DeepResearch Bench—35.1%
PostTrainBench—19%
GBAEval—45.1%
LMArena Search—1197
Vending-Bench 2—6,144

Reasoning GPT-5.4 leads

GPT-4 Turbo: 15.3 (#317), GPT-5.4: 61.8 (#19)

BenchmarkGPT-4 TurboGPT-5.4
Chess Puzzles6%44%
LMArena Hard Prompts12511485
DTBench61.6%94.4%
LMCA9.8%52%
Epoch Capabilities Index127.25156.81
ForecastBench59.459.5
ARC-AGI-2—74%
SimpleBench25.1%—
Kagi LLM Benchmark—63.8%
NYT Connections (extended)—91.3%
ARC-AGI-1—93.7%
CritPt—23.4%
EnigmaEval—16%
Thematic Generalization—80%
EBR-Bench—25.4%
Mystery Game Puzzles—37%

Math GPT-5.4 leads

GPT-4 Turbo: 9.0 (#322), GPT-5.4: 73.5 (#19)

BenchmarkGPT-4 TurboGPT-5.4
FrontierMath (Tiers 1-3)0.7%78.6%
OTIS Mock AIME 2024-20256.7%97.8%
LMArena Math12721488
FrontierMath Tier 4—49%
MathArena Final-Answer Competitions—83.1%
ProofBench—56%
MATH Level 546.7%—
FrontierMath (Feb 2025 set)—47.6%
FrontierMath Tier 4 (v1)—27.1%

Knowledge GPT-5.4 leads

GPT-4 Turbo: 24.3 (#268), GPT-5.4: 65.3 (#14)

BenchmarkGPT-4 TurboGPT-5.4
GPQA Diamond46.6%93.3%
LMArena Expert12231507
Humanity's Last Exam—36.2%
SimpleQA Verified—45.1%
Confabulations28.4%—
Vectara Hallucination Rate—7%
MMLU81.3%—

Multimodal GPT-5.4 leads

GPT-4 Turbo: 30.6 (#110), GPT-5.4: 43.7 (#20)

BenchmarkGPT-4 TurboGPT-5.4
LMArena Vision10901303
Blueprint-Bench 2—27.1%
Furniture Assembly—37.5%
LMArena Document—1471

Multilingual GPT-5.4 leads

GPT-4 Turbo: 40.5 (#216), GPT-5.4: 56.2 (#23)

BenchmarkGPT-4 TurboGPT-5.4
LMArena Non-English12451465
LMArena Chinese12421519
LMArena French12761493
LMArena German12591472
LMArena Japanese11941485
LMArena Korean11871448
LMArena Russian12591480
LMArena Spanish12601454

Instruction Following GPT-5.4 leads

GPT-4 Turbo: 65.8 (#216), GPT-5.4: 77.1 (#27)

BenchmarkGPT-4 TurboGPT-5.4
LMArena Instruction Following12491469

Long Context GPT-5.4 leads

GPT-4 Turbo: 38.0 (#206), GPT-5.4: 50.3 (#8)

BenchmarkGPT-4 TurboGPT-5.4
LMArena Longer Query12541473
CL-bench—27.9%
CL-bench Life—21.7%

Writing & Preference GPT-5.4 leads

GPT-4 Turbo: 47.7 (#206), GPT-5.4: 71.9 (#17)

BenchmarkGPT-4 TurboGPT-5.4
LMArena Text12721469
LMArena Creative Writing12691439
LMArena Multi-Turn12671482
EQ-Bench Creative Writing—1840
EQ-Bench 4—1272

Frequently asked questions

Is GPT-4 Turbo better than GPT-5.4?

GPT-5.4 is the stronger model overall, scoring 59.4 to 30.5 on the Noometry Index.

Which is cheaper, GPT-4 Turbo or GPT-5.4?

GPT-5.4 is cheaper. It lists at $2.50 per million input tokens and $15 per million output tokens; GPT-4 Turbo lists at $10 and $30.

Is GPT-4 Turbo or GPT-5.4 better for coding?

GPT-5.4 scores higher on coding benchmarks: 52.6 versus 33.8 in the Noometry coding category.

Which has the bigger context window?

GPT-5.4 does, with 1.05M tokens against 128K.

How many benchmarks do GPT-4 Turbo and GPT-5.4 share?

28 benchmarks have published results for both models. GPT-4 Turbo has 36 scored results on Noometry and GPT-5.4 has 68.

Related comparisons

Go deeper