Noometry

Model comparison

Amazon Nova Lite vs Mistral Nemo

Amazon Nova Lite is the stronger model overall, scoring 31.9 to 26.4 on the Noometry Index.

Last verified . 0 shared benchmarks.

Amazon Nova Lite Amazon

31.9

Rank #265 Confirmed

Mistral Nemo Mistral AI

26.4

Rank #337 Confirmed

Summary

  • The widest gap is in knowledge, where Amazon Nova Lite leads 26.3 to 12.3.
  • Amazon Nova Lite is cheaper at $0.06 / $0.24 per million input/output tokens, against $0.15 / $0.15 for Mistral Nemo.
  • Amazon Nova Lite accepts more context: 300K tokens versus 128K.
  • Mistral Nemo has downloadable open weights; the other is API-only.

Side by side

Amazon Nova LiteMistral Nemo
ProviderAmazonMistral AI
Noometry Index31.926.4
Released2024-12-032024-07-01
WeightsProprietaryOpen
Context window300K128K
Max output10K128K
Input $ / M tokens$0.06$0.15
Output $ / M tokens$0.24$0.15
Results tracked3410

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Amazon Nova Lite: 32.5 (#270), Mistral Nemo: —

BenchmarkAmazon Nova LiteMistral Nemo
LiveBench Coding27.5%—
LMArena Coding1239—
ALE-Bench236.25—

Agentic & Tool Use Not comparable

Amazon Nova Lite: —, Mistral Nemo: 23.5 (#125)

BenchmarkAmazon Nova LiteMistral Nemo
Berkeley Function Calling Leaderboard—27.6%
BALROG—17.6%

Reasoning Mistral Nemo leads

Amazon Nova Lite: 19.3 (#260), Mistral Nemo: 20.7 (#232)

BenchmarkAmazon Nova LiteMistral Nemo
LiveBench Reasoning36.7%—
LMArena Hard Prompts1220—
DTBench—48.6%
LiveBench Data Analysis37.2%—
Epoch Capabilities Index—118.68
LiveBench36.4%—
PIQA—83.5%

Math Amazon Nova Lite leads

Amazon Nova Lite: 27.8 (#247), Mistral Nemo: 25.5 (#268)

BenchmarkAmazon Nova LiteMistral Nemo
Omni-MATH23.3%—
LiveBench Math36.7%—
LMArena Math1227—
MATH Level 5—10.8%
GSM8K—84.2%

Knowledge Amazon Nova Lite leads

Amazon Nova Lite: 26.3 (#259), Mistral Nemo: 12.3 (#298)

BenchmarkAmazon Nova LiteMistral Nemo
GPQA Diamond—29.9%
Humanity's Last Exam3.6%—
MMLU-Pro60%—
Vectara Hallucination Rate6.1%—
GPQA (HELM)39.7%—
LMArena Expert1201—
BoolQ—82.5%
MMLU77%—

Multimodal Not comparable

Amazon Nova Lite: 25.5 (#123), Mistral Nemo: —

BenchmarkAmazon Nova LiteMistral Nemo
LMArena Vision990—

Multilingual Not comparable

Amazon Nova Lite: 38.0 (#232), Mistral Nemo: —

BenchmarkAmazon Nova LiteMistral Nemo
LMArena Non-English1208—
LMArena Chinese1225—
LMArena French1237—
LMArena German1229—
LMArena Japanese1153—
LMArena Korean1153—
LMArena Russian1216—
LMArena Spanish1226—

Instruction Following Not comparable

Amazon Nova Lite: 59.3 (#255), Mistral Nemo: —

BenchmarkAmazon Nova LiteMistral Nemo
LiveBench Instruction Following54.1%—
IFEval77.6%—
LMArena Instruction Following1205—

Long Context Not comparable

Amazon Nova Lite: 37.4 (#217), Mistral Nemo: —

BenchmarkAmazon Nova LiteMistral Nemo
LMArena Longer Query1234—

Writing & Preference Amazon Nova Lite leads

Amazon Nova Lite: 42.1 (#237), Mistral Nemo: 28.5 (#296)

BenchmarkAmazon Nova LiteMistral Nemo
LMArena Text1229—
LMArena Creative Writing1197—
EQ-Bench Creative Writing—881
WildBench75%—
LMArena Multi-Turn1199—
LiveBench Language25.9%—

Frequently asked questions

Is Amazon Nova Lite better than Mistral Nemo?

Amazon Nova Lite is the stronger model overall, scoring 31.9 to 26.4 on the Noometry Index.

Which is cheaper, Amazon Nova Lite or Mistral Nemo?

Amazon Nova Lite is cheaper. It lists at $0.06 per million input tokens and $0.24 per million output tokens; Mistral Nemo lists at $0.15 and $0.15.

Which has the bigger context window?

Amazon Nova Lite does, with 300K tokens against 128K.

How many benchmarks do Amazon Nova Lite and Mistral Nemo share?

0 benchmarks have published results for both models. Amazon Nova Lite has 34 scored results on Noometry and Mistral Nemo has 10.

Related comparisons

Go deeper