Model comparison

GPT-5.1-Codex vs Nemotron 4 340b Instruct

GPT-5.1-Codex is the stronger model overall, scoring 38.2 to 35.3 on the Noometry Index.

Last verified . 0 shared benchmarks.

GPT-5.1-Codex OpenAI

38.2

Rank #178 Reported

Nemotron 4 340b Instruct NVIDIA

35.3

Rank #218 Confirmed

Summary

  • The widest gap is in coding, where GPT-5.1-Codex leads 41.7 to 34.6.
  • Nemotron 4 340b Instruct has downloadable open weights; the other is API-only.

Side by side

GPT-5.1-Codex and Nemotron 4 340b Instruct specifications
GPT-5.1-CodexNemotron 4 340b Instruct
ProviderOpenAINVIDIA
Noometry Index38.235.3
Released2025-11-122024-06-14
WeightsProprietaryOpen
Context window400K—
Max output128K—
Input $ / M tokens$1.25—
Output $ / M tokens$10—
Results tracked617

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.1-Codex leads

GPT-5.1-Codex: 41.7 (#107), Nemotron 4 340b Instruct: 34.6 (#223)

Coding benchmarks
BenchmarkGPT-5.1-CodexNemotron 4 340b Instruct
SWE-bench Verified (bash only)66%—
LMArena WebDev1337—
LMArena Coding—1209
ALE-Bench1,245—

Agentic & Tool Use Not comparable

GPT-5.1-Codex: 37.8 (#32), Nemotron 4 340b Instruct: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.1-CodexNemotron 4 340b Instruct
Terminal-Bench60.4%—
METR Time Horizons70.8%—

Reasoning Not comparable

GPT-5.1-Codex: —, Nemotron 4 340b Instruct: 22.4 (#180)

Reasoning benchmarks
BenchmarkGPT-5.1-CodexNemotron 4 340b Instruct
LMArena Hard Prompts—1202

Math Nemotron 4 340b Instruct leads

GPT-5.1-Codex: 29.3 (#218), Nemotron 4 340b Instruct: 31.7 (#193)

Math benchmarks
BenchmarkGPT-5.1-CodexNemotron 4 340b Instruct
ProofBench9%—
LMArena Math—1216

Knowledge Not comparable

GPT-5.1-Codex: —, Nemotron 4 340b Instruct: 31.4 (#212)

Knowledge benchmarks
BenchmarkGPT-5.1-CodexNemotron 4 340b Instruct
LMArena Expert—1171

Multilingual Not comparable

GPT-5.1-Codex: —, Nemotron 4 340b Instruct: 38.0 (#228)

Multilingual benchmarks
BenchmarkGPT-5.1-CodexNemotron 4 340b Instruct
LMArena Non-English—1206
LMArena Chinese—1214
LMArena French—1196
LMArena German—1192
LMArena Japanese—1128
LMArena Korean—1148
LMArena Russian—1219
LMArena Spanish—1195

Instruction Following Not comparable

GPT-5.1-Codex: —, Nemotron 4 340b Instruct: 63.3 (#227)

Instruction Following benchmarks
BenchmarkGPT-5.1-CodexNemotron 4 340b Instruct
LMArena Instruction Following—1203

Long Context Not comparable

GPT-5.1-Codex: —, Nemotron 4 340b Instruct: 37.1 (#216)

Long Context benchmarks
BenchmarkGPT-5.1-CodexNemotron 4 340b Instruct
LMArena Longer Query—1225

Writing & Preference Not comparable

GPT-5.1-Codex: —, Nemotron 4 340b Instruct: 42.9 (#229)

Writing & Preference benchmarks
BenchmarkGPT-5.1-CodexNemotron 4 340b Instruct
LMArena Text—1225
LMArena Creative Writing—1203
LMArena Multi-Turn—1214

Frequently asked questions

Is GPT-5.1-Codex better than Nemotron 4 340b Instruct?

GPT-5.1-Codex is the stronger model overall, scoring 38.2 to 35.3 on the Noometry Index.

Is GPT-5.1-Codex or Nemotron 4 340b Instruct better for coding?

GPT-5.1-Codex scores higher on coding benchmarks: 41.7 versus 34.6 in the Noometry coding category.

How many benchmarks do GPT-5.1-Codex and Nemotron 4 340b Instruct share?

0 benchmarks have published results for both models. GPT-5.1-Codex has 6 scored results on Noometry and Nemotron 4 340b Instruct has 17.

Related comparisons

Go deeper