Model comparison

Llama 4 Scout vs Nemotron 3 Super

Nemotron 3 Super is the stronger model overall, scoring 39.6 to 27.4 on the Noometry Index.

Last verified . 17 shared benchmarks.

Llama 4 Scout Meta

27.4

Rank #323 Confirmed

Nemotron 3 Super NVIDIA

39.6

Rank #147 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Llama 4 Scout scores higher in 0 categories and Nemotron 3 Super in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Nemotron 3 Super leads 37.6 to 18.4.
  • The biggest single-benchmark swing is SciCode: 17% for Llama 4 Scout and 36% for Nemotron 3 Super.
  • Llama 4 Scout is cheaper at $0.10 / $0.30 per million input/output tokens, against $0.08 / $0.45 for Nemotron 3 Super.
  • Nemotron 3 Super accepts more context: 262K tokens versus 128K.

Side by side

Llama 4 Scout and Nemotron 3 Super specifications
Llama 4 ScoutNemotron 3 Super
ProviderMetaNVIDIA
Noometry Index27.439.6
Released2025-04-052026-03-11
WeightsOpenOpen
Context window128K262K
Max output4K131K
Input $ / M tokens$0.10$0.08
Output $ / M tokens$0.30$0.45
Results tracked4321

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nemotron 3 Super leads

Llama 4 Scout: 19.9 (#334), Nemotron 3 Super: 38.9 (#153)

Coding benchmarks
BenchmarkLlama 4 ScoutNemotron 3 Super
SciCode17%36%
LMArena Coding12861403
SWE-bench Verified (bash only)9.1%—
WeirdML—38%
BigCodeBench Complete43.1%—
ALE-Bench—213.9

Agentic & Tool Use Not comparable

Llama 4 Scout: 24.4 (#109), Nemotron 3 Super: —

Agentic & Tool Use benchmarks
BenchmarkLlama 4 ScoutNemotron 3 Super
Berkeley Function Calling Leaderboard28.1%—

Reasoning Nemotron 3 Super leads

Llama 4 Scout: 9.2 (#339), Nemotron 3 Super: 17.9 (#274)

Reasoning benchmarks
BenchmarkLlama 4 ScoutNemotron 3 Super
CritPt0%3.1%
LMArena Hard Prompts12661386
ARC-AGI-20%—
Kagi LLM Benchmark36.9%—
NYT Connections (extended)—15.4%
ARC-AGI-10.5%—
DTBench57.9%—
LMCA12%—
Epoch Capabilities Index129.64—
ForecastBench57.5—

Math Nemotron 3 Super leads

Llama 4 Scout: 18.4 (#280), Nemotron 3 Super: 37.6 (#95)

Math benchmarks
BenchmarkLlama 4 ScoutNemotron 3 Super
LMArena Math12861381
MathArena Final-Answer Competitions—60.4%
OTIS Mock AIME 2024-20257.8%—
Omni-MATH37.3%—
MATH Level 562.3%—
FrontierMath (Feb 2025 set)0%—

Knowledge Nemotron 3 Super leads

Llama 4 Scout: 31.8 (#208), Nemotron 3 Super: 38.2 (#136)

Knowledge benchmarks
BenchmarkLlama 4 ScoutNemotron 3 Super
LMArena Expert12361397
GPQA Diamond51.8%—
MMLU-Pro74.2%—
Vectara Hallucination Rate7.7%—
GPQA (HELM)50.7%—

Multimodal Not comparable

Llama 4 Scout: 31.6 (#98), Nemotron 3 Super: —

Multimodal benchmarks
BenchmarkLlama 4 ScoutNemotron 3 Super
LMArena Vision1118—
SpatialViz-Bench34.2%—

Multilingual Nemotron 3 Super leads

Llama 4 Scout: 41.3 (#207), Nemotron 3 Super: 48.6 (#139)

Multilingual benchmarks
BenchmarkLlama 4 ScoutNemotron 3 Super
LMArena Non-English12531356
LMArena Chinese12561430
LMArena French12831404
LMArena German12741341
LMArena Russian12631336
LMArena Spanish12771417
LMArena Japanese1209—
LMArena Korean1207—

Instruction Following Nemotron 3 Super leads

Llama 4 Scout: 66.0 (#212), Nemotron 3 Super: 71.4 (#149)

Instruction Following benchmarks
BenchmarkLlama 4 ScoutNemotron 3 Super
LMArena Instruction Following12481347
IFEval81.8%—

Long Context Nemotron 3 Super leads

Llama 4 Scout: 27.5 (#289), Nemotron 3 Super: 41.5 (#134)

Long Context benchmarks
BenchmarkLlama 4 ScoutNemotron 3 Super
LMArena Longer Query12651362
Fiction.LiveBench36%—

Writing & Preference Nemotron 3 Super leads

Llama 4 Scout: 37.1 (#256), Nemotron 3 Super: 56.1 (#135)

Writing & Preference benchmarks
BenchmarkLlama 4 ScoutNemotron 3 Super
LMArena Text12791378
LMArena Creative Writing12491317
LMArena Multi-Turn12811369
EQ-Bench Creative Writing783—
WildBench78%—

Frequently asked questions

Is Llama 4 Scout better than Nemotron 3 Super?

Nemotron 3 Super is the stronger model overall, scoring 39.6 to 27.4 on the Noometry Index.

Which is cheaper, Llama 4 Scout or Nemotron 3 Super?

Llama 4 Scout is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; Nemotron 3 Super lists at $0.08 and $0.45.

Is Llama 4 Scout or Nemotron 3 Super better for coding?

Nemotron 3 Super scores higher on coding benchmarks: 38.9 versus 19.9 in the Noometry coding category.

Which has the bigger context window?

Nemotron 3 Super does, with 262K tokens against 128K.

How many benchmarks do Llama 4 Scout and Nemotron 3 Super share?

17 benchmarks have published results for both models. Llama 4 Scout has 43 scored results on Noometry and Nemotron 3 Super has 21.

Related comparisons

Go deeper