Model comparison

Llama 3.1 Nemotron 70b Instruct vs Nvidia Llama 3.3 Nemotron Super 49b v1.5

Nvidia Llama 3.3 Nemotron Super 49b v1.5 is the stronger model overall, scoring 40.3 to 37.6 on the Noometry Index.

Last verified . 11 shared benchmarks.

Summary

  • They share 11 benchmarks with published results for both. Llama 3.1 Nemotron 70b Instruct scores higher in 0 categories and Nvidia Llama 3.3 Nemotron Super 49b v1.5 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where Nvidia Llama 3.3 Nemotron Super 49b v1.5 leads 45.5 to 40.5.

Side by side

Llama 3.1 Nemotron 70b Instruct and Nvidia Llama 3.3 Nemotron Super 49b v1.5 specifications
Llama 3.1 Nemotron 70b InstructNvidia Llama 3.3 Nemotron Super 49b v1.5
ProviderNVIDIANVIDIA
Noometry Index37.640.3
Released2024-12-182025-07-25
WeightsOpenOpen
Context window—131K
Max output—131K
Input $ / M tokens—$0.40
Output $ / M tokens—$0.40
Results tracked1412

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nvidia Llama 3.3 Nemotron Super 49b v1.5 leads

Llama 3.1 Nemotron 70b Instruct: 35.9 (#216), Nvidia Llama 3.3 Nemotron Super 49b v1.5: 39.8 (#154)

Coding benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructNvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Coding12721355
BigCodeBench Instruct38.7%—
BigCodeBench Complete48.2%—

Reasoning Nvidia Llama 3.3 Nemotron Super 49b v1.5 leads

Llama 3.1 Nemotron 70b Instruct: 25.0 (#152), Nvidia Llama 3.3 Nemotron Super 49b v1.5: 26.8 (#128)

Reasoning benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructNvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Hard Prompts12661336

Math Nvidia Llama 3.3 Nemotron Super 49b v1.5 leads

Llama 3.1 Nemotron 70b Instruct: 35.5 (#182), Nvidia Llama 3.3 Nemotron Super 49b v1.5: 38.2 (#141)

Math benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructNvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Math12711392

Knowledge Nvidia Llama 3.3 Nemotron Super 49b v1.5 leads

Llama 3.1 Nemotron 70b Instruct: 34.1 (#199), Nvidia Llama 3.3 Nemotron Super 49b v1.5: 36.7 (#165)

Knowledge benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructNvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Expert12421330

Multilingual Nvidia Llama 3.3 Nemotron Super 49b v1.5 leads

Llama 3.1 Nemotron 70b Instruct: 40.5 (#217), Nvidia Llama 3.3 Nemotron Super 49b v1.5: 45.5 (#168)

Multilingual benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructNvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Non-English12451316
LMArena Russian12271332
LMArena Chinese1263—
LMArena Japanese—1300

Instruction Following Nvidia Llama 3.3 Nemotron Super 49b v1.5 leads

Llama 3.1 Nemotron 70b Instruct: 65.9 (#213), Nvidia Llama 3.3 Nemotron Super 49b v1.5: 68.6 (#188)

Instruction Following benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructNvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Instruction Following12521299

Long Context Nvidia Llama 3.3 Nemotron Super 49b v1.5 leads

Llama 3.1 Nemotron 70b Instruct: 37.6 (#215), Nvidia Llama 3.3 Nemotron Super 49b v1.5: 40.0 (#164)

Long Context benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructNvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Longer Query12381315

Writing & Preference Nvidia Llama 3.3 Nemotron Super 49b v1.5 leads

Llama 3.1 Nemotron 70b Instruct: 48.4 (#203), Nvidia Llama 3.3 Nemotron Super 49b v1.5: 53.1 (#159)

Writing & Preference benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructNvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Text12831338
LMArena Creative Writing12691307
LMArena Multi-Turn12751334

Frequently asked questions

Is Llama 3.1 Nemotron 70b Instruct better than Nvidia Llama 3.3 Nemotron Super 49b v1.5?

Nvidia Llama 3.3 Nemotron Super 49b v1.5 is the stronger model overall, scoring 40.3 to 37.6 on the Noometry Index.

Is Llama 3.1 Nemotron 70b Instruct or Nvidia Llama 3.3 Nemotron Super 49b v1.5 better for coding?

Nvidia Llama 3.3 Nemotron Super 49b v1.5 scores higher on coding benchmarks: 39.8 versus 35.9 in the Noometry coding category.

How many benchmarks do Llama 3.1 Nemotron 70b Instruct and Nvidia Llama 3.3 Nemotron Super 49b v1.5 share?

11 benchmarks have published results for both models. Llama 3.1 Nemotron 70b Instruct has 14 scored results on Noometry and Nvidia Llama 3.3 Nemotron Super 49b v1.5 has 12.

Related comparisons

Go deeper