Model comparison

Llama 3-70B vs Nemotron 3 Super

Nemotron 3 Super is the stronger model overall, scoring 39.6 to 28.5 on the Noometry Index.

Last verified . 15 shared benchmarks.

Llama 3-70B Meta

28.5

Rank #317 Confirmed

Nemotron 3 Super NVIDIA

39.6

Rank #147 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Llama 3-70B scores higher in 0 categories and Nemotron 3 Super in 8 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where Nemotron 3 Super leads 37.6 to 12.0.

Side by side

Llama 3-70B and Nemotron 3 Super specifications
Llama 3-70BNemotron 3 Super
ProviderMetaNVIDIA
Noometry Index28.539.6
Released2024-04-182026-03-11
WeightsOpenOpen
Context window—262K
Max output—131K
Input $ / M tokens—$0.08
Output $ / M tokens—$0.45
Results tracked3121

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nemotron 3 Super leads

Llama 3-70B: 35.3 (#215), Nemotron 3 Super: 38.9 (#153)

Coding benchmarks
BenchmarkLlama 3-70BNemotron 3 Super
LMArena Coding12061403
SciCode—36%
WeirdML—38%
BigCodeBench Instruct43.6%—
BigCodeBench Complete54.5%—
ALE-Bench—213.9
HumanEval+72%—
MBPP+69%—

Agentic & Tool Use Not comparable

Llama 3-70B: 20.9 (#132), Nemotron 3 Super: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3-70BNemotron 3 Super
Cybench5%—

Reasoning Too close to call

Llama 3-70B: 17.4 (#284), Nemotron 3 Super: 17.9 (#274)

Reasoning benchmarks
BenchmarkLlama 3-70BNemotron 3 Super
LMArena Hard Prompts11951386
Kagi LLM Benchmark35.1%—
NYT Connections (extended)—15.4%
CritPt—3.1%
DTBench54.2%—
Epoch Capabilities Index122.91—
ForecastBench57.1—
WinoGrande83.5%—

Math Nemotron 3 Super leads

Llama 3-70B: 12.0 (#299), Nemotron 3 Super: 37.6 (#95)

Math benchmarks
BenchmarkLlama 3-70BNemotron 3 Super
LMArena Math12181381
MathArena Final-Answer Competitions—60.4%
OTIS Mock AIME 2024-20254.3%—
MATH Level 522.6%—

Knowledge Nemotron 3 Super leads

Llama 3-70B: 20.8 (#272), Nemotron 3 Super: 38.2 (#136)

Knowledge benchmarks
BenchmarkLlama 3-70BNemotron 3 Super
LMArena Expert11491397
GPQA Diamond40.6%—
MMLU79.3%—

Multilingual Nemotron 3 Super leads

Llama 3-70B: 33.8 (#246), Nemotron 3 Super: 48.6 (#139)

Multilingual benchmarks
BenchmarkLlama 3-70BNemotron 3 Super
LMArena Non-English11421356
LMArena Chinese11141430
LMArena French12311404
LMArena German11691341
LMArena Russian11591336
LMArena Spanish12411417
LMArena Japanese1017—
LMArena Korean1017—

Instruction Following Nemotron 3 Super leads

Llama 3-70B: 62.8 (#233), Nemotron 3 Super: 71.4 (#149)

Instruction Following benchmarks
BenchmarkLlama 3-70BNemotron 3 Super
LMArena Instruction Following11941347

Long Context Nemotron 3 Super leads

Llama 3-70B: 35.6 (#235), Nemotron 3 Super: 41.5 (#134)

Long Context benchmarks
BenchmarkLlama 3-70BNemotron 3 Super
LMArena Longer Query11741362

Writing & Preference Nemotron 3 Super leads

Llama 3-70B: 43.0 (#225), Nemotron 3 Super: 56.1 (#135)

Writing & Preference benchmarks
BenchmarkLlama 3-70BNemotron 3 Super
LMArena Text12211378
LMArena Creative Writing12101317
LMArena Multi-Turn12231369

Frequently asked questions

Is Llama 3-70B better than Nemotron 3 Super?

Nemotron 3 Super is the stronger model overall, scoring 39.6 to 28.5 on the Noometry Index.

Is Llama 3-70B or Nemotron 3 Super better for coding?

Nemotron 3 Super scores higher on coding benchmarks: 38.9 versus 35.3 in the Noometry coding category.

How many benchmarks do Llama 3-70B and Nemotron 3 Super share?

15 benchmarks have published results for both models. Llama 3-70B has 31 scored results on Noometry and Nemotron 3 Super has 21.

Related comparisons

Go deeper