Model comparison

GPT-5.4 Pro vs Nemotron 4 340b Instruct

GPT-5.4 Pro is the stronger model overall, scoring 58.8 to 35.3 on the Noometry Index.

Last verified . 0 shared benchmarks.

GPT-5.4 Pro OpenAI

58.8

Rank #16 Confirmed

Nemotron 4 340b Instruct NVIDIA

35.3

Rank #218 Confirmed

Summary

  • The widest gap is in reasoning, where GPT-5.4 Pro leads 71.0 to 22.4.
  • Nemotron 4 340b Instruct has downloadable open weights; the other is API-only.

Side by side

GPT-5.4 Pro and Nemotron 4 340b Instruct specifications
GPT-5.4 ProNemotron 4 340b Instruct
ProviderOpenAINVIDIA
Noometry Index58.835.3
Released2026-03-052024-06-14
WeightsProprietaryOpen
Context window1.05M—
Max output128K—
Input $ / M tokens$30—
Output $ / M tokens$180—
Results tracked1617

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.4 Pro leads

GPT-5.4 Pro: 42.6 (#89), Nemotron 4 340b Instruct: 34.6 (#223)

Coding benchmarks
BenchmarkGPT-5.4 ProNemotron 4 340b Instruct
WeirdML57.4%—
LMArena Coding—1209

Reasoning GPT-5.4 Pro leads

GPT-5.4 Pro: 71.0 (#10), Nemotron 4 340b Instruct: 22.4 (#180)

Reasoning benchmarks
BenchmarkGPT-5.4 ProNemotron 4 340b Instruct
ARC-AGI-283.3%—
SimpleBench74.1%—
ARC-AGI-194.5%—
CritPt30%—
Chess Puzzles58.6%—
EnigmaEval23.8%—
LMArena Hard Prompts—1202
Epoch Capabilities Index159.12—

Math GPT-5.4 Pro leads

GPT-5.4 Pro: 72.0 (#17), Nemotron 4 340b Instruct: 31.7 (#193)

Math benchmarks
BenchmarkGPT-5.4 ProNemotron 4 340b Instruct
FrontierMath (Tiers 1-3)82.5%—
FrontierMath Tier 458.5%—
LMArena Math—1216
FrontierMath (Feb 2025 set)50%—
FrontierMath Tier 4 (v1)37.5%—

Knowledge GPT-5.4 Pro leads

GPT-5.4 Pro: 68.3 (#6), Nemotron 4 340b Instruct: 31.4 (#212)

Knowledge benchmarks
BenchmarkGPT-5.4 ProNemotron 4 340b Instruct
GPQA Diamond94.6%—
Humanity's Last Exam44.3%—
SimpleQA Verified46.3%—
Vectara Hallucination Rate8.3%—
LMArena Expert—1171

Multilingual Not comparable

GPT-5.4 Pro: —, Nemotron 4 340b Instruct: 38.0 (#228)

Multilingual benchmarks
BenchmarkGPT-5.4 ProNemotron 4 340b Instruct
LMArena Non-English—1206
LMArena Chinese—1214
LMArena French—1196
LMArena German—1192
LMArena Japanese—1128
LMArena Korean—1148
LMArena Russian—1219
LMArena Spanish—1195

Instruction Following Not comparable

GPT-5.4 Pro: —, Nemotron 4 340b Instruct: 63.3 (#227)

Instruction Following benchmarks
BenchmarkGPT-5.4 ProNemotron 4 340b Instruct
LMArena Instruction Following—1203

Long Context Not comparable

GPT-5.4 Pro: —, Nemotron 4 340b Instruct: 37.1 (#216)

Long Context benchmarks
BenchmarkGPT-5.4 ProNemotron 4 340b Instruct
LMArena Longer Query—1225

Writing & Preference Not comparable

GPT-5.4 Pro: —, Nemotron 4 340b Instruct: 42.9 (#229)

Writing & Preference benchmarks
BenchmarkGPT-5.4 ProNemotron 4 340b Instruct
LMArena Text—1225
LMArena Creative Writing—1203
LMArena Multi-Turn—1214

Frequently asked questions

Is GPT-5.4 Pro better than Nemotron 4 340b Instruct?

GPT-5.4 Pro is the stronger model overall, scoring 58.8 to 35.3 on the Noometry Index.

Is GPT-5.4 Pro or Nemotron 4 340b Instruct better for coding?

GPT-5.4 Pro scores higher on coding benchmarks: 42.6 versus 34.6 in the Noometry coding category.

How many benchmarks do GPT-5.4 Pro and Nemotron 4 340b Instruct share?

0 benchmarks have published results for both models. GPT-5.4 Pro has 16 scored results on Noometry and Nemotron 4 340b Instruct has 17.

Related comparisons

Go deeper