Noometry

Model comparison

Amazon Nova Experimental Chat 26 02 10 vs Nemotron 4 340b Instruct

Amazon Nova Experimental Chat 26 02 10 is the stronger model overall, scoring 44.5 to 35.9 on the Noometry Index.

Last verified . 12 shared benchmarks.

Amazon Nova Experimental Chat 26 02 10 Amazon

44.5

Rank #77 Confirmed

Nemotron 4 340b Instruct NVIDIA

35.9

Rank #223 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Amazon Nova Experimental Chat 26 02 10 scores higher in 8 categories and Nemotron 4 340b Instruct in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Experimental Chat 26 02 10 leads 61.8 to 42.7.
  • Nemotron 4 340b Instruct has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Experimental Chat 26 02 10Nemotron 4 340b Instruct
ProviderAmazonNVIDIA
Noometry Index44.535.9
Released—2024-06-14
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1217

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 43.9 (#82), Nemotron 4 340b Instruct: 35.2 (#228)

BenchmarkAmazon Nova Experimental Chat 26 02 10Nemotron 4 340b Instruct
LMArena Coding14831209

Reasoning Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 30.1 (#86), Nemotron 4 340b Instruct: 23.4 (#178)

BenchmarkAmazon Nova Experimental Chat 26 02 10Nemotron 4 340b Instruct
LMArena Hard Prompts14581202

Math Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 39.3 (#109), Nemotron 4 340b Instruct: 34.3 (#195)

BenchmarkAmazon Nova Experimental Chat 26 02 10Nemotron 4 340b Instruct
LMArena Math14381216

Knowledge Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 42.3 (#97), Nemotron 4 340b Instruct: 32.0 (#216)

BenchmarkAmazon Nova Experimental Chat 26 02 10Nemotron 4 340b Instruct
LMArena Expert15061171

Multilingual Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 54.0 (#50), Nemotron 4 340b Instruct: 37.9 (#233)

BenchmarkAmazon Nova Experimental Chat 26 02 10Nemotron 4 340b Instruct
LMArena Non-English14341206
LMArena Chinese14631214
LMArena Russian14231219
LMArena French—1197
LMArena German—1192
LMArena Japanese—1128
LMArena Korean—1148
LMArena Spanish—1195

Instruction Following Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 75.2 (#69), Nemotron 4 340b Instruct: 63.1 (#232)

BenchmarkAmazon Nova Experimental Chat 26 02 10Nemotron 4 340b Instruct
LMArena Instruction Following14271203

Long Context Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 44.0 (#77), Nemotron 4 340b Instruct: 37.1 (#221)

BenchmarkAmazon Nova Experimental Chat 26 02 10Nemotron 4 340b Instruct
LMArena Longer Query14411225

Writing & Preference Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 61.8 (#84), Nemotron 4 340b Instruct: 42.7 (#233)

BenchmarkAmazon Nova Experimental Chat 26 02 10Nemotron 4 340b Instruct
LMArena Text14481225
LMArena Creative Writing13681203
LMArena Multi-Turn14421214

Frequently asked questions

Is Amazon Nova Experimental Chat 26 02 10 better than Nemotron 4 340b Instruct?

Amazon Nova Experimental Chat 26 02 10 is the stronger model overall, scoring 44.5 to 35.9 on the Noometry Index.

Is Amazon Nova Experimental Chat 26 02 10 or Nemotron 4 340b Instruct better for coding?

Amazon Nova Experimental Chat 26 02 10 scores higher on coding benchmarks: 43.9 versus 35.2 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 26 02 10 and Nemotron 4 340b Instruct share?

12 benchmarks have published results for both models. Amazon Nova Experimental Chat 26 02 10 has 12 scored results on Noometry and Nemotron 4 340b Instruct has 17.

Related comparisons

Go deeper