Noometry

Model comparison

Amazon Nova Micro vs Mistral 7B

Amazon Nova Micro is the stronger model overall, scoring 30.4 to 23.0 on the Noometry Index.

Last verified . 17 shared benchmarks.

Amazon Nova Micro Amazon

30.4

Rank #294 Confirmed

Mistral 7B Mistral AI

23.0

Rank #351 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Amazon Nova Micro scores higher in 8 categories and Mistral 7B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Amazon Nova Micro leads 29.6 to 7.4.
  • Amazon Nova Micro is cheaper at $0.035 / $0.14 per million input/output tokens, against $0.25 / $0.25 for Mistral 7B.
  • Amazon Nova Micro accepts more context: 128K tokens versus 8K.
  • Mistral 7B has downloadable open weights; the other is API-only.

Side by side

Amazon Nova MicroMistral 7B
ProviderAmazonMistral AI
Noometry Index30.423.0
Released2024-12-032023-09-27
WeightsProprietaryOpen
Context window128K8K
Max output10K8K
Input $ / M tokens$0.035$0.25
Output $ / M tokens$0.14$0.25
Results tracked3237

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Micro leads

Amazon Nova Micro: 30.5 (#295), Mistral 7B: 26.4 (#326)

BenchmarkAmazon Nova MicroMistral 7B
LMArena Coding12181082
BigCodeBench Instruct—19.5%
LiveBench Coding20.2%—
BigCodeBench Complete—27.3%
HumanEval+—36%
MBPP+—42.1%

Agentic & Tool Use Not comparable

Amazon Nova Micro: 22.1 (#132), Mistral 7B: —

BenchmarkAmazon Nova MicroMistral 7B
Berkeley Function Calling Leaderboard22.3%—

Reasoning Amazon Nova Micro leads

Amazon Nova Micro: 17.4 (#294), Mistral 7B: 13.1 (#336)

BenchmarkAmazon Nova MicroMistral 7B
LMArena Hard Prompts11911067
Chess Puzzles—0%
LiveBench Reasoning25.1%—
DTBench—42.5%
LiveBench Data Analysis34%—
Adversarial NLI—47.1%
BIG-Bench Hard—56.1%
Epoch Capabilities Index—112.21
HellaSwag—81%
LiveBench29.6%—
PIQA—83%
WinoGrande—75.3%

Math Amazon Nova Micro leads

Amazon Nova Micro: 26.9 (#254), Mistral 7B: 8.1 (#325)

BenchmarkAmazon Nova MicroMistral 7B
LMArena Math12061085
OTIS Mock AIME 2024-2025—0.3%
Omni-MATH21.4%—
LiveBench Math34.5%—
MATH Level 5—3.7%
GSM8K—54.4%

Knowledge Amazon Nova Micro leads

Amazon Nova Micro: 29.6 (#237), Mistral 7B: 7.4 (#311)

BenchmarkAmazon Nova MicroMistral 7B
LMArena Expert11841036
MMLU70.8%62.5%
GPQA Diamond—15.2%
MMLU-Pro51.1%—
Vectara Hallucination Rate5.5%—
GPQA (HELM)38.3%—
ARC (AI2) Challenge—78.6%
BoolQ—87.4%
OpenBookQA—79.8%
TriviaQA—75.2%

Multilingual Amazon Nova Micro leads

Amazon Nova Micro: 36.5 (#239), Mistral 7B: 25.8 (#283)

BenchmarkAmazon Nova MicroMistral 7B
LMArena Non-English11861012
LMArena Chinese12091009
LMArena French12381037
LMArena German1192987
LMArena Japanese1154878
LMArena Russian11851018
LMArena Spanish12251026
LMArena Korean1150—

Instruction Following Amazon Nova Micro leads

Amazon Nova Micro: 56.3 (#272), Mistral 7B: 54.2 (#280)

BenchmarkAmazon Nova MicroMistral 7B
LMArena Instruction Following11741060
LiveBench Instruction Following48%—
IFEval76%—

Long Context Amazon Nova Micro leads

Amazon Nova Micro: 36.5 (#229), Mistral 7B: 32.2 (#271)

BenchmarkAmazon Nova MicroMistral 7B
LMArena Longer Query12051060

Writing & Preference Amazon Nova Micro leads

Amazon Nova Micro: 39.5 (#247), Mistral 7B: 30.7 (#286)

BenchmarkAmazon Nova MicroMistral 7B
LMArena Text12081090
LMArena Creative Writing11721068
LMArena Multi-Turn11781062
WildBench74.3%—
LiveBench Language15.8%—

Frequently asked questions

Is Amazon Nova Micro better than Mistral 7B?

Amazon Nova Micro is the stronger model overall, scoring 30.4 to 23.0 on the Noometry Index.

Which is cheaper, Amazon Nova Micro or Mistral 7B?

Amazon Nova Micro is cheaper. It lists at $0.035 per million input tokens and $0.14 per million output tokens; Mistral 7B lists at $0.25 and $0.25.

Is Amazon Nova Micro or Mistral 7B better for coding?

Amazon Nova Micro scores higher on coding benchmarks: 30.5 versus 26.4 in the Noometry coding category.

Which has the bigger context window?

Amazon Nova Micro does, with 128K tokens against 8K.

How many benchmarks do Amazon Nova Micro and Mistral 7B share?

17 benchmarks have published results for both models. Amazon Nova Micro has 32 scored results on Noometry and Mistral 7B has 37.

Related comparisons

Go deeper