Noometry

Model comparison

Amazon Nova Lite vs Nemotron 4 340b Instruct

Nemotron 4 340b Instruct is the stronger model overall, scoring 35.9 to 31.9 on the Noometry Index.

Last verified . 17 shared benchmarks.

Amazon Nova Lite Amazon

31.9

Rank #265 Confirmed

Nemotron 4 340b Instruct NVIDIA

35.9

Rank #223 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Amazon Nova Lite scores higher in 2 categories and Nemotron 4 340b Instruct in 6 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in math, where Nemotron 4 340b Instruct leads 34.3 to 27.8.
  • Nemotron 4 340b Instruct has downloadable open weights; the other is API-only.

Side by side

Amazon Nova LiteNemotron 4 340b Instruct
ProviderAmazonNVIDIA
Noometry Index31.935.9
Released2024-12-032024-06-14
WeightsProprietaryOpen
Context window300K—
Max output10K—
Input $ / M tokens$0.06—
Output $ / M tokens$0.24—
Results tracked3417

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nemotron 4 340b Instruct leads

Amazon Nova Lite: 32.5 (#270), Nemotron 4 340b Instruct: 35.2 (#228)

BenchmarkAmazon Nova LiteNemotron 4 340b Instruct
LMArena Coding12391209
LiveBench Coding27.5%—
ALE-Bench236.25—

Reasoning Nemotron 4 340b Instruct leads

Amazon Nova Lite: 19.3 (#260), Nemotron 4 340b Instruct: 23.4 (#178)

BenchmarkAmazon Nova LiteNemotron 4 340b Instruct
LMArena Hard Prompts12201202
LiveBench Reasoning36.7%—
LiveBench Data Analysis37.2%—
LiveBench36.4%—

Math Nemotron 4 340b Instruct leads

Amazon Nova Lite: 27.8 (#247), Nemotron 4 340b Instruct: 34.3 (#195)

BenchmarkAmazon Nova LiteNemotron 4 340b Instruct
LMArena Math12271216
Omni-MATH23.3%—
LiveBench Math36.7%—

Knowledge Nemotron 4 340b Instruct leads

Amazon Nova Lite: 26.3 (#259), Nemotron 4 340b Instruct: 32.0 (#216)

BenchmarkAmazon Nova LiteNemotron 4 340b Instruct
LMArena Expert12011171
Humanity's Last Exam3.6%—
MMLU-Pro60%—
Vectara Hallucination Rate6.1%—
GPQA (HELM)39.7%—
MMLU77%—

Multimodal Not comparable

Amazon Nova Lite: 25.5 (#123), Nemotron 4 340b Instruct: —

BenchmarkAmazon Nova LiteNemotron 4 340b Instruct
LMArena Vision990—

Multilingual Too close to call

Amazon Nova Lite: 38.0 (#232), Nemotron 4 340b Instruct: 37.9 (#233)

BenchmarkAmazon Nova LiteNemotron 4 340b Instruct
LMArena Non-English12081206
LMArena Chinese12251214
LMArena French12371197
LMArena German12291192
LMArena Japanese11531128
LMArena Korean11531148
LMArena Russian12161219
LMArena Spanish12261195

Instruction Following Nemotron 4 340b Instruct leads

Amazon Nova Lite: 59.3 (#255), Nemotron 4 340b Instruct: 63.1 (#232)

BenchmarkAmazon Nova LiteNemotron 4 340b Instruct
LMArena Instruction Following12051203
LiveBench Instruction Following54.1%—
IFEval77.6%—

Long Context Too close to call

Amazon Nova Lite: 37.4 (#217), Nemotron 4 340b Instruct: 37.1 (#221)

BenchmarkAmazon Nova LiteNemotron 4 340b Instruct
LMArena Longer Query12341225

Writing & Preference Too close to call

Amazon Nova Lite: 42.1 (#237), Nemotron 4 340b Instruct: 42.7 (#233)

BenchmarkAmazon Nova LiteNemotron 4 340b Instruct
LMArena Text12291225
LMArena Creative Writing11971203
LMArena Multi-Turn11991214
WildBench75%—
LiveBench Language25.9%—

Frequently asked questions

Is Amazon Nova Lite better than Nemotron 4 340b Instruct?

Nemotron 4 340b Instruct is the stronger model overall, scoring 35.9 to 31.9 on the Noometry Index.

Is Amazon Nova Lite or Nemotron 4 340b Instruct better for coding?

Nemotron 4 340b Instruct scores higher on coding benchmarks: 35.2 versus 32.5 in the Noometry coding category.

How many benchmarks do Amazon Nova Lite and Nemotron 4 340b Instruct share?

17 benchmarks have published results for both models. Amazon Nova Lite has 34 scored results on Noometry and Nemotron 4 340b Instruct has 17.

Related comparisons

Go deeper