Model comparison

Claude 2.1 vs Nemotron 3 Super

Nemotron 3 Super is the stronger model overall, scoring 39.6 to 24.9 on the Noometry Index.

Last verified . 1 shared benchmarks.

Claude 2.1 Anthropic

24.9

Rank #340 Reported

Nemotron 3 Super NVIDIA

39.6

Rank #147 Confirmed

Summary

  • They share 1 benchmark with published results for both. Claude 2.1 scores higher in 1 category and Nemotron 3 Super in 3 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Nemotron 3 Super leads 37.6 to 9.6.
  • The biggest single-benchmark swing is WeirdML: 7.1% for Claude 2.1 and 38% for Nemotron 3 Super.
  • Nemotron 3 Super has downloadable open weights; the other is API-only.

Side by side

Claude 2.1 and Nemotron 3 Super specifications
Claude 2.1Nemotron 3 Super
ProviderAnthropicNVIDIA
Noometry Index24.939.6
Released2023-11-212026-03-11
WeightsProprietaryOpen
Context window—262K
Max output—131K
Input $ / M tokens—$0.08
Output $ / M tokens—$0.45
Results tracked721

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nemotron 3 Super leads

Claude 2.1: 25.8 (#322), Nemotron 3 Super: 38.9 (#153)

Coding benchmarks
BenchmarkClaude 2.1Nemotron 3 Super
WeirdML7.1%38%
SciCode—36%
LMArena Coding—1403
ALE-Bench—213.9

Reasoning Claude 2.1 leads

Claude 2.1: 20.6 (#216), Nemotron 3 Super: 17.9 (#274)

Reasoning benchmarks
BenchmarkClaude 2.1Nemotron 3 Super
NYT Connections (extended)—15.4%
CritPt—3.1%
LMArena Hard Prompts—1386
DTBench51%—
Epoch Capabilities Index119.22—
ForecastBench54.2—

Math Nemotron 3 Super leads

Claude 2.1: 9.6 (#309), Nemotron 3 Super: 37.6 (#95)

Math benchmarks
BenchmarkClaude 2.1Nemotron 3 Super
MathArena Final-Answer Competitions—60.4%
OTIS Mock AIME 2024-20251.9%—
LMArena Math—1381

Knowledge Nemotron 3 Super leads

Claude 2.1: 15.5 (#287), Nemotron 3 Super: 38.2 (#136)

Knowledge benchmarks
BenchmarkClaude 2.1Nemotron 3 Super
GPQA Diamond33%—
LMArena Expert—1397
MMLU73.5%—

Multilingual Not comparable

Claude 2.1: —, Nemotron 3 Super: 48.6 (#139)

Multilingual benchmarks
BenchmarkClaude 2.1Nemotron 3 Super
LMArena Non-English—1356
LMArena Chinese—1430
LMArena French—1404
LMArena German—1341
LMArena Russian—1336
LMArena Spanish—1417

Instruction Following Not comparable

Claude 2.1: —, Nemotron 3 Super: 71.4 (#149)

Instruction Following benchmarks
BenchmarkClaude 2.1Nemotron 3 Super
LMArena Instruction Following—1347

Long Context Not comparable

Claude 2.1: —, Nemotron 3 Super: 41.5 (#134)

Long Context benchmarks
BenchmarkClaude 2.1Nemotron 3 Super
LMArena Longer Query—1362

Writing & Preference Not comparable

Claude 2.1: —, Nemotron 3 Super: 56.1 (#135)

Writing & Preference benchmarks
BenchmarkClaude 2.1Nemotron 3 Super
LMArena Text—1378
LMArena Creative Writing—1317
LMArena Multi-Turn—1369

Frequently asked questions

Is Claude 2.1 better than Nemotron 3 Super?

Nemotron 3 Super is the stronger model overall, scoring 39.6 to 24.9 on the Noometry Index.

Is Claude 2.1 or Nemotron 3 Super better for coding?

Nemotron 3 Super scores higher on coding benchmarks: 38.9 versus 25.8 in the Noometry coding category.

How many benchmarks do Claude 2.1 and Nemotron 3 Super share?

1 benchmark has published results for both models. Claude 2.1 has 7 scored results on Noometry and Nemotron 3 Super has 21.

Related comparisons

Go deeper