Model comparison

Llama 13b vs Nemotron 3 Super

Nemotron 3 Super is the stronger model overall, scoring 40.1 to 24.4 on the Noometry Index.

Last verified . 8 shared benchmarks.

Llama 13b Meta

24.4

Rank #348 Confirmed

Nemotron 3 Super NVIDIA

40.1

Rank #153 Confirmed

Summary

  • They share 8 benchmarks with published results for both. Llama 13b scores higher in 0 categories and Nemotron 3 Super in 6 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Nemotron 3 Super leads 55.9 to 13.8.

Side by side

Llama 13b and Nemotron 3 Super specifications
Llama 13bNemotron 3 Super
ProviderMetaNVIDIA
Noometry Index24.440.1
Released2023-02-242026-03-11
WeightsOpenOpen
Context window—262K
Max output—131K
Input $ / M tokens—$0.08
Output $ / M tokens—$0.45
Results tracked2121

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nemotron 3 Super leads

Llama 13b: 21.4 (#337), Nemotron 3 Super: 39.4 (#158)

Coding benchmarks
BenchmarkLlama 13bNemotron 3 Super
LMArena Coding6831403
SciCode—36%
WeirdML—38%
ALE-Bench—213.9

Reasoning Nemotron 3 Super leads

Llama 13b: 14.0 (#329), Nemotron 3 Super: 18.7 (#276)

Reasoning benchmarks
BenchmarkLlama 13bNemotron 3 Super
LMArena Hard Prompts7281386
NYT Connections (extended)—15.4%
CritPt—3.1%
BIG-Bench Hard37.9%—
Epoch Capabilities Index100.58—
HellaSwag79.2%—
LAMBADA75.2%—
PIQA80.1%—
WinoGrande73%—

Math Nemotron 3 Super leads

Llama 13b: 26.7 (#256), Nemotron 3 Super: 39.6 (#101)

Math benchmarks
BenchmarkLlama 13bNemotron 3 Super
LMArena Math8381380
MathArena Final-Answer Competitions—60.4%
GSM8K20.6%—

Knowledge Not comparable

Llama 13b: —, Nemotron 3 Super: 38.9 (#139)

Knowledge benchmarks
BenchmarkLlama 13bNemotron 3 Super
LMArena Expert—1398
ARC (AI2) Challenge52.7%—
BoolQ78.7%—
MMLU47.7%—
OpenBookQA56.4%—
TriviaQA77.9%—

Multimodal Not comparable

Llama 13b: —, Nemotron 3 Super: —

Multimodal benchmarks
BenchmarkLlama 13bNemotron 3 Super
ScienceQA43.3%—

Multilingual Nemotron 3 Super leads

Llama 13b: 16.6 (#297), Nemotron 3 Super: 48.4 (#144)

Multilingual benchmarks
BenchmarkLlama 13bNemotron 3 Super
LMArena Non-English8191355
LMArena Chinese—1432
LMArena French—1405
LMArena German—1341
LMArena Russian—1336
LMArena Spanish—1417

Instruction Following Nemotron 3 Super leads

Llama 13b: 36.7 (#305), Nemotron 3 Super: 71.2 (#154)

Instruction Following benchmarks
BenchmarkLlama 13bNemotron 3 Super
LMArena Instruction Following7811347

Long Context Not comparable

Llama 13b: —, Nemotron 3 Super: 41.5 (#139)

Long Context benchmarks
BenchmarkLlama 13bNemotron 3 Super
LMArena Longer Query—1362

Writing & Preference Nemotron 3 Super leads

Llama 13b: 13.8 (#312), Nemotron 3 Super: 55.9 (#140)

Writing & Preference benchmarks
BenchmarkLlama 13bNemotron 3 Super
LMArena Text8341378
LMArena Creative Writing7941317
LMArena Multi-Turn7531369

Frequently asked questions

Is Llama 13b better than Nemotron 3 Super?

Nemotron 3 Super is the stronger model overall, scoring 40.1 to 24.4 on the Noometry Index.

Is Llama 13b or Nemotron 3 Super better for coding?

Nemotron 3 Super scores higher on coding benchmarks: 39.4 versus 21.4 in the Noometry coding category.

How many benchmarks do Llama 13b and Nemotron 3 Super share?

8 benchmarks have published results for both models. Llama 13b has 21 scored results on Noometry and Nemotron 3 Super has 21.

Related comparisons

Go deeper