Model comparison

Llama 3.1 Nemotron 51b Instruct vs Nvidia Llama 3.3 Nemotron Super 49b v1.5

Nvidia Llama 3.3 Nemotron Super 49b v1.5 is the stronger model overall, scoring 40.3 to 35.9 on the Noometry Index.

Last verified . 11 shared benchmarks.

Summary

  • They share 11 benchmarks with published results for both. Llama 3.1 Nemotron 51b Instruct scores higher in 0 categories and Nvidia Llama 3.3 Nemotron Super 49b v1.5 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Nvidia Llama 3.3 Nemotron Super 49b v1.5 leads 53.1 to 43.4.

Side by side

Llama 3.1 Nemotron 51b Instruct and Nvidia Llama 3.3 Nemotron Super 49b v1.5 specifications
Llama 3.1 Nemotron 51b InstructNvidia Llama 3.3 Nemotron Super 49b v1.5
ProviderNVIDIANVIDIA
Noometry Index35.940.3
Released—2025-07-25
WeightsOpenOpen
Context window—131K
Max output—131K
Input $ / M tokens—$0.40
Output $ / M tokens—$0.40
Results tracked1212

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nvidia Llama 3.3 Nemotron Super 49b v1.5 leads

Llama 3.1 Nemotron 51b Instruct: 35.6 (#222), Nvidia Llama 3.3 Nemotron Super 49b v1.5: 39.8 (#154)

Coding benchmarks
BenchmarkLlama 3.1 Nemotron 51b InstructNvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Coding12231355

Reasoning Nvidia Llama 3.3 Nemotron Super 49b v1.5 leads

Llama 3.1 Nemotron 51b Instruct: 23.5 (#177), Nvidia Llama 3.3 Nemotron Super 49b v1.5: 26.8 (#128)

Reasoning benchmarks
BenchmarkLlama 3.1 Nemotron 51b InstructNvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Hard Prompts12031336

Math Nvidia Llama 3.3 Nemotron Super 49b v1.5 leads

Llama 3.1 Nemotron 51b Instruct: 34.6 (#193), Nvidia Llama 3.3 Nemotron Super 49b v1.5: 38.2 (#141)

Math benchmarks
BenchmarkLlama 3.1 Nemotron 51b InstructNvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Math12301392

Knowledge Nvidia Llama 3.3 Nemotron Super 49b v1.5 leads

Llama 3.1 Nemotron 51b Instruct: 31.9 (#218), Nvidia Llama 3.3 Nemotron Super 49b v1.5: 36.7 (#165)

Knowledge benchmarks
BenchmarkLlama 3.1 Nemotron 51b InstructNvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Expert11671330

Multilingual Nvidia Llama 3.3 Nemotron Super 49b v1.5 leads

Llama 3.1 Nemotron 51b Instruct: 36.1 (#241), Nvidia Llama 3.3 Nemotron Super 49b v1.5: 45.5 (#168)

Multilingual benchmarks
BenchmarkLlama 3.1 Nemotron 51b InstructNvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Non-English11811316
LMArena Russian11871332
LMArena Chinese1180—
LMArena Japanese—1300

Instruction Following Nvidia Llama 3.3 Nemotron Super 49b v1.5 leads

Llama 3.1 Nemotron 51b Instruct: 62.9 (#233), Nvidia Llama 3.3 Nemotron Super 49b v1.5: 68.6 (#188)

Instruction Following benchmarks
BenchmarkLlama 3.1 Nemotron 51b InstructNvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Instruction Following12011299

Long Context Nvidia Llama 3.3 Nemotron Super 49b v1.5 leads

Llama 3.1 Nemotron 51b Instruct: 36.5 (#230), Nvidia Llama 3.3 Nemotron Super 49b v1.5: 40.0 (#164)

Long Context benchmarks
BenchmarkLlama 3.1 Nemotron 51b InstructNvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Longer Query12051315

Writing & Preference Nvidia Llama 3.3 Nemotron Super 49b v1.5 leads

Llama 3.1 Nemotron 51b Instruct: 43.4 (#229), Nvidia Llama 3.3 Nemotron Super 49b v1.5: 53.1 (#159)

Writing & Preference benchmarks
BenchmarkLlama 3.1 Nemotron 51b InstructNvidia Llama 3.3 Nemotron Super 49b v1.5
LMArena Text12281338
LMArena Creative Writing12131307
LMArena Multi-Turn12271334

Frequently asked questions

Is Llama 3.1 Nemotron 51b Instruct better than Nvidia Llama 3.3 Nemotron Super 49b v1.5?

Nvidia Llama 3.3 Nemotron Super 49b v1.5 is the stronger model overall, scoring 40.3 to 35.9 on the Noometry Index.

Is Llama 3.1 Nemotron 51b Instruct or Nvidia Llama 3.3 Nemotron Super 49b v1.5 better for coding?

Nvidia Llama 3.3 Nemotron Super 49b v1.5 scores higher on coding benchmarks: 39.8 versus 35.6 in the Noometry coding category.

How many benchmarks do Llama 3.1 Nemotron 51b Instruct and Nvidia Llama 3.3 Nemotron Super 49b v1.5 share?

11 benchmarks have published results for both models. Llama 3.1 Nemotron 51b Instruct has 12 scored results on Noometry and Nvidia Llama 3.3 Nemotron Super 49b v1.5 has 12.

Related comparisons

Go deeper