Model comparison

Llama-3.3-70B-Instruct vs Nemotron 3 Super

Nemotron 3 Super is the stronger model overall, scoring 40.1 to 30.6 on the Noometry Index.

Last verified . 18 shared benchmarks.

Llama-3.3-70B-Instruct Meta

30.6

Rank #291 Confirmed

Nemotron 3 Super NVIDIA

40.1

Rank #153 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Llama-3.3-70B-Instruct scores higher in 0 categories and Nemotron 3 Super in 8 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where Nemotron 3 Super leads 39.6 to 15.3.
  • The biggest single-benchmark swing is WeirdML: 14.4% for Llama-3.3-70B-Instruct and 38% for Nemotron 3 Super.
  • Llama-3.3-70B-Instruct is cheaper at $0.10 / $0.32 per million input/output tokens, against $0.08 / $0.45 for Nemotron 3 Super.
  • Nemotron 3 Super accepts more context: 262K tokens versus 128K.

Side by side

Llama-3.3-70B-Instruct and Nemotron 3 Super specifications
Llama-3.3-70B-InstructNemotron 3 Super
ProviderMetaNVIDIA
Noometry Index30.640.1
Released2024-12-062026-03-11
WeightsOpenOpen
Context window128K262K
Max output4K131K
Input $ / M tokens$0.10$0.08
Output $ / M tokens$0.32$0.45
Results tracked4321

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nemotron 3 Super leads

Llama-3.3-70B-Instruct: 31.0 (#290), Nemotron 3 Super: 39.4 (#158)

Coding benchmarks
BenchmarkLlama-3.3-70B-InstructNemotron 3 Super
SciCode26%36%
WeirdML14.4%38%
LMArena Coding12681403
BigCodeBench Instruct46.9%—
LiveBench Coding36.6%—
BigCodeBench Complete57.5%—
ALE-Bench—213.9

Agentic & Tool Use Not comparable

Llama-3.3-70B-Instruct: 25.8 (#105), Nemotron 3 Super: —

Agentic & Tool Use benchmarks
BenchmarkLlama-3.3-70B-InstructNemotron 3 Super
Berkeley Function Calling Leaderboard31.9%—
BALROG23%—

Reasoning Nemotron 3 Super leads

Llama-3.3-70B-Instruct: 14.1 (#327), Nemotron 3 Super: 18.7 (#276)

Reasoning benchmarks
BenchmarkLlama-3.3-70B-InstructNemotron 3 Super
CritPt0%3.1%
LMArena Hard Prompts12571386
SimpleBench19.9%—
NYT Connections (extended)—15.4%
LiveBench Reasoning50.8%—
DTBench59.5%—
LiveBench Data Analysis49.5%—
LMCA17.5%—
Epoch Capabilities Index127.33—
ForecastBench58.6—
LiveBench50.2%—

Math Nemotron 3 Super leads

Llama-3.3-70B-Instruct: 15.3 (#298), Nemotron 3 Super: 39.6 (#101)

Math benchmarks
BenchmarkLlama-3.3-70B-InstructNemotron 3 Super
LMArena Math12671380
MathArena Final-Answer Competitions—60.4%
OTIS Mock AIME 2024-20255.1%—
LiveBench Math42.2%—
MATH Level 541.6%—

Knowledge Nemotron 3 Super leads

Llama-3.3-70B-Instruct: 30.6 (#226), Nemotron 3 Super: 38.9 (#139)

Knowledge benchmarks
BenchmarkLlama-3.3-70B-InstructNemotron 3 Super
LMArena Expert12251398
GPQA Diamond47.4%—
Confabulations22.8%—
Vectara Hallucination Rate4.1%—
MMLU86.3%—

Multilingual Nemotron 3 Super leads

Llama-3.3-70B-Instruct: 39.9 (#220), Nemotron 3 Super: 48.4 (#144)

Multilingual benchmarks
BenchmarkLlama-3.3-70B-InstructNemotron 3 Super
LMArena Non-English12361355
LMArena Chinese12171432
LMArena French12811405
LMArena German12511341
LMArena Russian12521336
LMArena Spanish12701417
LMArena Japanese1150—
LMArena Korean1143—

Instruction Following Too close to call

Llama-3.3-70B-Instruct: 71.1 (#157), Nemotron 3 Super: 71.2 (#154)

Instruction Following benchmarks
BenchmarkLlama-3.3-70B-InstructNemotron 3 Super
LMArena Instruction Following12421347
LiveBench Instruction Following82.7%—

Long Context Nemotron 3 Super leads

Llama-3.3-70B-Instruct: 26.4 (#295), Nemotron 3 Super: 41.5 (#139)

Long Context benchmarks
BenchmarkLlama-3.3-70B-InstructNemotron 3 Super
LMArena Longer Query12561362
Fiction.LiveBench33.3%—

Writing & Preference Nemotron 3 Super leads

Llama-3.3-70B-Instruct: 47.6 (#207), Nemotron 3 Super: 55.9 (#140)

Writing & Preference benchmarks
BenchmarkLlama-3.3-70B-InstructNemotron 3 Super
LMArena Text12741378
LMArena Creative Writing12501317
LMArena Multi-Turn12801369
LiveBench Language39.2%—

Frequently asked questions

Is Llama-3.3-70B-Instruct better than Nemotron 3 Super?

Nemotron 3 Super is the stronger model overall, scoring 40.1 to 30.6 on the Noometry Index.

Which is cheaper, Llama-3.3-70B-Instruct or Nemotron 3 Super?

Llama-3.3-70B-Instruct is cheaper. It lists at $0.10 per million input tokens and $0.32 per million output tokens; Nemotron 3 Super lists at $0.08 and $0.45.

Is Llama-3.3-70B-Instruct or Nemotron 3 Super better for coding?

Nemotron 3 Super scores higher on coding benchmarks: 39.4 versus 31.0 in the Noometry coding category.

Which has the bigger context window?

Nemotron 3 Super does, with 262K tokens against 128K.

How many benchmarks do Llama-3.3-70B-Instruct and Nemotron 3 Super share?

18 benchmarks have published results for both models. Llama-3.3-70B-Instruct has 43 scored results on Noometry and Nemotron 3 Super has 21.

Related comparisons

Go deeper