Model comparison

Amazon Nova Experimental Chat 10 20 vs Nemotron 3 Ultra

Amazon Nova Experimental Chat 10 20 and Nemotron 3 Ultra score almost the same on the Noometry Index (42.1 vs 42.5), so choose on price, context window or the category you care about most.

Last verified . 16 shared benchmarks.

Nemotron 3 Ultra NVIDIA

42.5

Rank #113 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Amazon Nova Experimental Chat 10 20 scores higher in 2 categories and Nemotron 3 Ultra in 6 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Nemotron 3 Ultra leads 52.5 to 38.5.
  • Nemotron 3 Ultra has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Experimental Chat 10 20 and Nemotron 3 Ultra specifications
Amazon Nova Experimental Chat 10 20Nemotron 3 Ultra
ProviderAmazonNVIDIA
Noometry Index42.142.5
Released—2026-06-04
WeightsProprietaryOpen
Context window—262K
Max output—128K
Input $ / M tokens—$0.50
Output $ / M tokens—$2.20
Results tracked1730

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 41.6 (#123), Nemotron 3 Ultra: 38.1 (#182)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Nemotron 3 Ultra
LMArena Coding14121468
FrontierCode—13.6%
SciCode—40.3%
WeirdML—43.5%

Agentic & Tool Use Not comparable

Amazon Nova Experimental Chat 10 20: —, Nemotron 3 Ultra: 23.4 (#126)

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Nemotron 3 Ultra
APEX-Agents—22.7%

Reasoning Nemotron 3 Ultra leads

Amazon Nova Experimental Chat 10 20: 28.4 (#106), Nemotron 3 Ultra: 31.0 (#82)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Nemotron 3 Ultra
LMArena Hard Prompts13961452
CritPt—3.1%
Chess Puzzles—12%
Mystery Game Puzzles—20%
DTBench—90.1%
LMCA—36.9%
Epoch Capabilities Index—146.17

Math Amazon Nova Experimental Chat 10 20 leads

Amazon Nova Experimental Chat 10 20: 39.0 (#119), Nemotron 3 Ultra: 35.3 (#187)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Nemotron 3 Ultra
LMArena Math14251457
OTIS Mock AIME 2024-2025—86.7%
ProofBench—2%

Knowledge Nemotron 3 Ultra leads

Amazon Nova Experimental Chat 10 20: 38.5 (#144), Nemotron 3 Ultra: 52.5 (#61)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Nemotron 3 Ultra
LMArena Expert13861472
GPQA Diamond—85.4%

Multilingual Nemotron 3 Ultra leads

Amazon Nova Experimental Chat 10 20: 49.5 (#131), Nemotron 3 Ultra: 53.5 (#64)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Nemotron 3 Ultra
LMArena Non-English13721427
LMArena Chinese14041497
LMArena French14251472
LMArena German13911471
LMArena Korean13241386
LMArena Russian13711417
LMArena Spanish13821454
LMArena Japanese1360—

Instruction Following Nemotron 3 Ultra leads

Amazon Nova Experimental Chat 10 20: 72.1 (#141), Nemotron 3 Ultra: 74.7 (#88)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Nemotron 3 Ultra
LMArena Instruction Following13651418

Long Context Nemotron 3 Ultra leads

Amazon Nova Experimental Chat 10 20: 41.7 (#133), Nemotron 3 Ultra: 43.9 (#81)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Nemotron 3 Ultra
LMArena Longer Query13701437

Writing & Preference Nemotron 3 Ultra leads

Amazon Nova Experimental Chat 10 20: 56.6 (#136), Nemotron 3 Ultra: 66.3 (#36)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 10 20Nemotron 3 Ultra
LMArena Text13941445
LMArena Creative Writing13181398
LMArena Multi-Turn13641411
EQ-Bench Creative Writing—1692

Frequently asked questions

Is Amazon Nova Experimental Chat 10 20 better than Nemotron 3 Ultra?

Amazon Nova Experimental Chat 10 20 and Nemotron 3 Ultra score almost the same on the Noometry Index (42.1 vs 42.5), so choose on price, context window or the category you care about most.

Is Amazon Nova Experimental Chat 10 20 or Nemotron 3 Ultra better for coding?

Amazon Nova Experimental Chat 10 20 scores higher on coding benchmarks: 41.6 versus 38.1 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 10 20 and Nemotron 3 Ultra share?

16 benchmarks have published results for both models. Amazon Nova Experimental Chat 10 20 has 17 scored results on Noometry and Nemotron 3 Ultra has 30.

Related comparisons

Go deeper