Noometry

Model comparison

Amazon Nova Micro vs Mistral Nemo

Amazon Nova Micro is the stronger model overall, scoring 30.4 to 26.4 on the Noometry Index.

Last verified . 1 shared benchmarks.

Amazon Nova Micro Amazon

30.4

Rank #294 Confirmed

Mistral Nemo Mistral AI

26.4

Rank #337 Confirmed

Summary

  • They share 1 benchmark with published results for both. Amazon Nova Micro scores higher in 3 categories and Mistral Nemo in 2 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Amazon Nova Micro leads 29.6 to 12.3.
  • The biggest single-benchmark swing is Berkeley Function Calling Leaderboard: 22.3% for Amazon Nova Micro and 27.6% for Mistral Nemo.
  • Amazon Nova Micro is cheaper at $0.035 / $0.14 per million input/output tokens, against $0.15 / $0.15 for Mistral Nemo.
  • Mistral Nemo has downloadable open weights; the other is API-only.

Side by side

Amazon Nova MicroMistral Nemo
ProviderAmazonMistral AI
Noometry Index30.426.4
Released2024-12-032024-07-01
WeightsProprietaryOpen
Context window128K128K
Max output10K128K
Input $ / M tokens$0.035$0.15
Output $ / M tokens$0.14$0.15
Results tracked3210

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Amazon Nova Micro: 30.5 (#295), Mistral Nemo: —

BenchmarkAmazon Nova MicroMistral Nemo
LiveBench Coding20.2%—
LMArena Coding1218—

Agentic & Tool Use Mistral Nemo leads

Amazon Nova Micro: 22.1 (#132), Mistral Nemo: 23.5 (#125)

BenchmarkAmazon Nova MicroMistral Nemo
Berkeley Function Calling Leaderboard22.3%27.6%
BALROG—17.6%

Reasoning Mistral Nemo leads

Amazon Nova Micro: 17.4 (#294), Mistral Nemo: 20.7 (#232)

BenchmarkAmazon Nova MicroMistral Nemo
LiveBench Reasoning25.1%—
LMArena Hard Prompts1191—
DTBench—48.6%
LiveBench Data Analysis34%—
Epoch Capabilities Index—118.68
LiveBench29.6%—
PIQA—83.5%

Math Amazon Nova Micro leads

Amazon Nova Micro: 26.9 (#254), Mistral Nemo: 25.5 (#268)

BenchmarkAmazon Nova MicroMistral Nemo
Omni-MATH21.4%—
LiveBench Math34.5%—
LMArena Math1206—
MATH Level 5—10.8%
GSM8K—84.2%

Knowledge Amazon Nova Micro leads

Amazon Nova Micro: 29.6 (#237), Mistral Nemo: 12.3 (#298)

BenchmarkAmazon Nova MicroMistral Nemo
GPQA Diamond—29.9%
MMLU-Pro51.1%—
Vectara Hallucination Rate5.5%—
GPQA (HELM)38.3%—
LMArena Expert1184—
BoolQ—82.5%
MMLU70.8%—

Multilingual Not comparable

Amazon Nova Micro: 36.5 (#239), Mistral Nemo: —

BenchmarkAmazon Nova MicroMistral Nemo
LMArena Non-English1186—
LMArena Chinese1209—
LMArena French1238—
LMArena German1192—
LMArena Japanese1154—
LMArena Korean1150—
LMArena Russian1185—
LMArena Spanish1225—

Instruction Following Not comparable

Amazon Nova Micro: 56.3 (#272), Mistral Nemo: —

BenchmarkAmazon Nova MicroMistral Nemo
LiveBench Instruction Following48%—
IFEval76%—
LMArena Instruction Following1174—

Long Context Not comparable

Amazon Nova Micro: 36.5 (#229), Mistral Nemo: —

BenchmarkAmazon Nova MicroMistral Nemo
LMArena Longer Query1205—

Writing & Preference Amazon Nova Micro leads

Amazon Nova Micro: 39.5 (#247), Mistral Nemo: 28.5 (#296)

BenchmarkAmazon Nova MicroMistral Nemo
LMArena Text1208—
LMArena Creative Writing1172—
EQ-Bench Creative Writing—881
WildBench74.3%—
LMArena Multi-Turn1178—
LiveBench Language15.8%—

Frequently asked questions

Is Amazon Nova Micro better than Mistral Nemo?

Amazon Nova Micro is the stronger model overall, scoring 30.4 to 26.4 on the Noometry Index.

Which is cheaper, Amazon Nova Micro or Mistral Nemo?

Amazon Nova Micro is cheaper. It lists at $0.035 per million input tokens and $0.14 per million output tokens; Mistral Nemo lists at $0.15 and $0.15.

Which has the bigger context window?

Both accept 128K tokens.

How many benchmarks do Amazon Nova Micro and Mistral Nemo share?

1 benchmark has published results for both models. Amazon Nova Micro has 32 scored results on Noometry and Mistral Nemo has 10.

Related comparisons

Go deeper