Noometry

Model comparison

GPT-4.5 vs Nemotron 4 340b Instruct

GPT-4.5 is the stronger model overall, scoring 37.2 to 35.9 on the Noometry Index.

Last verified . 16 shared benchmarks.

GPT-4.5 OpenAI

37.2

Rank #208 Confirmed

Nemotron 4 340b Instruct NVIDIA

35.9

Rank #223 Confirmed

Summary

  • They share 16 benchmarks with published results for both. GPT-4.5 scores higher in 6 categories and Nemotron 4 340b Instruct in 2 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where GPT-4.5 leads 52.5 to 37.9.
  • Nemotron 4 340b Instruct has downloadable open weights; the other is API-only.

Side by side

GPT-4.5Nemotron 4 340b Instruct
ProviderOpenAINVIDIA
Noometry Index37.235.9
Released2025-02-272024-06-14
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked4217

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-4.5 leads

GPT-4.5: 42.2 (#109), Nemotron 4 340b Instruct: 35.2 (#228)

BenchmarkGPT-4.5Nemotron 4 340b Instruct
LMArena Coding13961209
Aider Polyglot44.9%—
WeirdML39.4%—
LiveBench Coding75.2%—

Agentic & Tool Use Not comparable

GPT-4.5: 27.9 (#97), Nemotron 4 340b Instruct: —

BenchmarkGPT-4.5Nemotron 4 340b Instruct
Cybench17.5%—

Reasoning Nemotron 4 340b Instruct leads

GPT-4.5: 13.9 (#330), Nemotron 4 340b Instruct: 23.4 (#178)

BenchmarkGPT-4.5Nemotron 4 340b Instruct
LMArena Hard Prompts14031202
ARC-AGI-20.8%—
SimpleBench34.5%—
ARC-AGI-110.3%—
EnigmaEval3.2%—
LiveBench Reasoning71.1%—
LiveBench Data Analysis64.3%—
Epoch Capabilities Index136.74—
ForecastBench61.7—
LiveBench69%—

Math Nemotron 4 340b Instruct leads

GPT-4.5: 32.6 (#211), Nemotron 4 340b Instruct: 34.3 (#195)

BenchmarkGPT-4.5Nemotron 4 340b Instruct
LMArena Math14121216
OTIS Mock AIME 2024-202537.8%—
LiveBench Math69.3%—
MATH Level 578.6%—

Knowledge Too close to call

GPT-4.5: 32.5 (#211), Nemotron 4 340b Instruct: 32.0 (#216)

BenchmarkGPT-4.5Nemotron 4 340b Instruct
LMArena Expert13941171
GPQA Diamond68.7%—
Humanity's Last Exam5.4%—
Confabulations13.6%—

Multimodal Not comparable

GPT-4.5: 37.6 (#71), Nemotron 4 340b Instruct: —

BenchmarkGPT-4.5Nemotron 4 340b Instruct
LMArena Vision1195—
VPCT45%—

Multilingual GPT-4.5 leads

GPT-4.5: 52.5 (#83), Nemotron 4 340b Instruct: 37.9 (#233)

BenchmarkGPT-4.5Nemotron 4 340b Instruct
LMArena Non-English14131206
LMArena Chinese14211214
LMArena French14181197
LMArena German14571192
LMArena Japanese14161128
LMArena Korean13921148
LMArena Russian14191219
LMArena Spanish—1195

Instruction Following GPT-4.5 leads

GPT-4.5: 72.6 (#134), Nemotron 4 340b Instruct: 63.1 (#232)

BenchmarkGPT-4.5Nemotron 4 340b Instruct
LMArena Instruction Following14041203
LiveBench Instruction Following72.3%—

Long Context GPT-4.5 leads

GPT-4.5: 40.4 (#155), Nemotron 4 340b Instruct: 37.1 (#221)

BenchmarkGPT-4.5Nemotron 4 340b Instruct
LMArena Longer Query14061225
Fiction.LiveBench63.9%—

Writing & Preference GPT-4.5 leads

GPT-4.5: 56.9 (#134), Nemotron 4 340b Instruct: 42.7 (#233)

BenchmarkGPT-4.5Nemotron 4 340b Instruct
LMArena Text14171225
LMArena Creative Writing13941203
LMArena Multi-Turn14441214
Short-Story Creative Writing75.6%—
EQ-Bench Creative Writing1258—
LiveBench Language61.5%—

Frequently asked questions

Is GPT-4.5 better than Nemotron 4 340b Instruct?

GPT-4.5 is the stronger model overall, scoring 37.2 to 35.9 on the Noometry Index.

Is GPT-4.5 or Nemotron 4 340b Instruct better for coding?

GPT-4.5 scores higher on coding benchmarks: 42.2 versus 35.2 in the Noometry coding category.

How many benchmarks do GPT-4.5 and Nemotron 4 340b Instruct share?

16 benchmarks have published results for both models. GPT-4.5 has 42 scored results on Noometry and Nemotron 4 340b Instruct has 17.

Related comparisons

Go deeper