Model comparison

Amazon Nova Pro vs Nemotron 3 Ultra

Nemotron 3 Ultra is the stronger model overall, scoring 42.5 to 31.0 on the Noometry Index.

Last verified . 17 shared benchmarks.

Amazon Nova Pro Amazon

31.0

Rank #281 Confirmed

Nemotron 3 Ultra NVIDIA

42.5

Rank #113 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Amazon Nova Pro scores higher in 0 categories and Nemotron 3 Ultra in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Nemotron 3 Ultra leads 52.5 to 27.4.
  • Nemotron 3 Ultra is cheaper at $0.50 / $2.20 per million input/output tokens, against $0.80 / $3.20 for Amazon Nova Pro.
  • Amazon Nova Pro accepts more context: 300K tokens versus 262K.
  • Nemotron 3 Ultra has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Pro and Nemotron 3 Ultra specifications
Amazon Nova ProNemotron 3 Ultra
ProviderAmazonNVIDIA
Noometry Index31.042.5
Released2024-12-032026-06-04
WeightsProprietaryOpen
Context window300K262K
Max output10K128K
Input $ / M tokens$0.80$0.50
Output $ / M tokens$3.20$2.20
Results tracked3830

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nemotron 3 Ultra leads

Amazon Nova Pro: 35.1 (#229), Nemotron 3 Ultra: 38.1 (#182)

Coding benchmarks
BenchmarkAmazon Nova ProNemotron 3 Ultra
LMArena Coding12701468
FrontierCode—13.6%
SciCode—40.3%
WeirdML—43.5%
LiveBench Coding38.1%—

Agentic & Tool Use Nemotron 3 Ultra leads

Amazon Nova Pro: 16.7 (#147), Nemotron 3 Ultra: 23.4 (#126)

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova ProNemotron 3 Ultra
APEX-Agents—22.7%
Berkeley Function Calling Leaderboard25%—
TheAgentCompany1.7%—

Reasoning Nemotron 3 Ultra leads

Amazon Nova Pro: 20.0 (#243), Nemotron 3 Ultra: 31.0 (#82)

Reasoning benchmarks
BenchmarkAmazon Nova ProNemotron 3 Ultra
LMArena Hard Prompts12461452
Epoch Capabilities Index123.8146.17
CritPt—3.1%
Chess Puzzles—12%
LiveBench Reasoning32.6%—
Mystery Game Puzzles—20%
DTBench—90.1%
LiveBench Data Analysis48.3%—
LMCA—36.9%
LiveBench43.5%—

Math Nemotron 3 Ultra leads

Amazon Nova Pro: 28.5 (#243), Nemotron 3 Ultra: 35.3 (#187)

Math benchmarks
BenchmarkAmazon Nova ProNemotron 3 Ultra
LMArena Math12521457
OTIS Mock AIME 2024-2025—86.7%
ProofBench—2%
Omni-MATH24.2%—
LiveBench Math38%—

Knowledge Nemotron 3 Ultra leads

Amazon Nova Pro: 27.4 (#250), Nemotron 3 Ultra: 52.5 (#61)

Knowledge benchmarks
BenchmarkAmazon Nova ProNemotron 3 Ultra
LMArena Expert12111472
GPQA Diamond—85.4%
Humanity's Last Exam4.4%—
MMLU-Pro67.3%—
Confabulations30.1%—
Vectara Hallucination Rate5.1%—
GPQA (HELM)44.6%—
MMLU82%—

Multimodal Not comparable

Amazon Nova Pro: 25.0 (#126), Nemotron 3 Ultra: —

Multimodal benchmarks
BenchmarkAmazon Nova ProNemotron 3 Ultra
LMArena Vision980—

Multilingual Nemotron 3 Ultra leads

Amazon Nova Pro: 39.7 (#223), Nemotron 3 Ultra: 53.5 (#64)

Multilingual benchmarks
BenchmarkAmazon Nova ProNemotron 3 Ultra
LMArena Non-English12341427
LMArena Chinese12441497
LMArena French12711472
LMArena German12431471
LMArena Korean12031386
LMArena Russian12401417
LMArena Spanish11821454
LMArena Japanese1200—

Instruction Following Nemotron 3 Ultra leads

Amazon Nova Pro: 64.9 (#226), Nemotron 3 Ultra: 74.7 (#88)

Instruction Following benchmarks
BenchmarkAmazon Nova ProNemotron 3 Ultra
LMArena Instruction Following12351418
LiveBench Instruction Following67.1%—
IFEval81.5%—

Long Context Nemotron 3 Ultra leads

Amazon Nova Pro: 38.1 (#205), Nemotron 3 Ultra: 43.9 (#81)

Long Context benchmarks
BenchmarkAmazon Nova ProNemotron 3 Ultra
LMArena Longer Query12551437

Writing & Preference Nemotron 3 Ultra leads

Amazon Nova Pro: 43.9 (#226), Nemotron 3 Ultra: 66.3 (#36)

Writing & Preference benchmarks
BenchmarkAmazon Nova ProNemotron 3 Ultra
LMArena Text12591445
LMArena Creative Writing12121398
LMArena Multi-Turn12461411
Short-Story Creative Writing60.5%—
EQ-Bench Creative Writing—1692
WildBench77.7%—
LiveBench Language37%—

Frequently asked questions

Is Amazon Nova Pro better than Nemotron 3 Ultra?

Nemotron 3 Ultra is the stronger model overall, scoring 42.5 to 31.0 on the Noometry Index.

Which is cheaper, Amazon Nova Pro or Nemotron 3 Ultra?

Nemotron 3 Ultra is cheaper. It lists at $0.50 per million input tokens and $2.20 per million output tokens; Amazon Nova Pro lists at $0.80 and $3.20.

Is Amazon Nova Pro or Nemotron 3 Ultra better for coding?

Nemotron 3 Ultra scores higher on coding benchmarks: 38.1 versus 35.1 in the Noometry coding category.

Which has the bigger context window?

Amazon Nova Pro does, with 300K tokens against 262K.

How many benchmarks do Amazon Nova Pro and Nemotron 3 Ultra share?

17 benchmarks have published results for both models. Amazon Nova Pro has 38 scored results on Noometry and Nemotron 3 Ultra has 30.

Related comparisons

Go deeper