Noometry

Model comparison

Amazon Nova Micro vs Mistral Medium 3.5

Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 30.4 on the Noometry Index. Amazon Nova Micro costs 49× less per token, which makes it the better buy when Mistral Medium 3.5's lead doesn't matter for your workload.

Last verified . 16 shared benchmarks.

Amazon Nova Micro Amazon

30.4

Rank #294 Confirmed

Mistral Medium 3.5 Mistral AI

40.2

Rank #152 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Amazon Nova Micro scores higher in 1 category and Mistral Medium 3.5 in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Mistral Medium 3.5 leads 58.5 to 39.5.
  • Amazon Nova Micro is cheaper at $0.035 / $0.14 per million input/output tokens, against $1.50 / $7.50 for Mistral Medium 3.5.
  • Mistral Medium 3.5 accepts more context: 262K tokens versus 128K.
  • Mistral Medium 3.5 has downloadable open weights; the other is API-only.

Side by side

Amazon Nova MicroMistral Medium 3.5
ProviderAmazonMistral AI
Noometry Index30.440.2
Released2024-12-03—
WeightsProprietaryOpen
Context window128K262K
Max output10K210K
Input $ / M tokens$0.035$1.50
Output $ / M tokens$0.14$7.50
Results tracked3222

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Medium 3.5 leads

Amazon Nova Micro: 30.5 (#295), Mistral Medium 3.5: 36.0 (#213)

BenchmarkAmazon Nova MicroMistral Medium 3.5
LMArena Coding12181461
LMArena WebDev—1264
LiveBench Coding20.2%—

Agentic & Tool Use Not comparable

Amazon Nova Micro: 22.1 (#132), Mistral Medium 3.5: —

BenchmarkAmazon Nova MicroMistral Medium 3.5
Berkeley Function Calling Leaderboard22.3%—

Reasoning Too close to call

Amazon Nova Micro: 17.4 (#294), Mistral Medium 3.5: 17.3 (#295)

BenchmarkAmazon Nova MicroMistral Medium 3.5
LMArena Hard Prompts11911436
Kagi LLM Benchmark—41.4%
NYT Connections (extended)—12.9%
LiveBench Reasoning25.1%—
LiveBench Data Analysis34%—
Epoch Capabilities Index—141.35
LiveBench29.6%—

Math Mistral Medium 3.5 leads

Amazon Nova Micro: 26.9 (#254), Mistral Medium 3.5: 39.1 (#113)

BenchmarkAmazon Nova MicroMistral Medium 3.5
LMArena Math12061431
Omni-MATH21.4%—
LiveBench Math34.5%—

Knowledge Mistral Medium 3.5 leads

Amazon Nova Micro: 29.6 (#237), Mistral Medium 3.5: 40.0 (#126)

BenchmarkAmazon Nova MicroMistral Medium 3.5
LMArena Expert11841432
MMLU-Pro51.1%—
Vectara Hallucination Rate5.5%—
GPQA (HELM)38.3%—
MMLU70.8%—

Multimodal Not comparable

Amazon Nova Micro: —, Mistral Medium 3.5: 38.3 (#65)

BenchmarkAmazon Nova MicroMistral Medium 3.5
LMArena Vision—1223

Multilingual Mistral Medium 3.5 leads

Amazon Nova Micro: 36.5 (#239), Mistral Medium 3.5: 51.9 (#100)

BenchmarkAmazon Nova MicroMistral Medium 3.5
LMArena Non-English11861404
LMArena Chinese12091442
LMArena French12381448
LMArena German11921451
LMArena Korean11501385
LMArena Russian11851395
LMArena Spanish12251409
LMArena Japanese1154—

Instruction Following Mistral Medium 3.5 leads

Amazon Nova Micro: 56.3 (#272), Mistral Medium 3.5: 74.6 (#90)

BenchmarkAmazon Nova MicroMistral Medium 3.5
LMArena Instruction Following11741415
LiveBench Instruction Following48%—
IFEval76%—

Long Context Mistral Medium 3.5 leads

Amazon Nova Micro: 36.5 (#229), Mistral Medium 3.5: 43.2 (#103)

BenchmarkAmazon Nova MicroMistral Medium 3.5
LMArena Longer Query12051415

Writing & Preference Mistral Medium 3.5 leads

Amazon Nova Micro: 39.5 (#247), Mistral Medium 3.5: 58.5 (#117)

BenchmarkAmazon Nova MicroMistral Medium 3.5
LMArena Text12081421
LMArena Creative Writing11721374
LMArena Multi-Turn11781423
WildBench74.3%—
EQ-Bench 4—993
LiveBench Language15.8%—

Frequently asked questions

Is Amazon Nova Micro better than Mistral Medium 3.5?

Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 30.4 on the Noometry Index. Amazon Nova Micro costs 49× less per token, which makes it the better buy when Mistral Medium 3.5's lead doesn't matter for your workload.

Which is cheaper, Amazon Nova Micro or Mistral Medium 3.5?

Amazon Nova Micro is cheaper. It lists at $0.035 per million input tokens and $0.14 per million output tokens; Mistral Medium 3.5 lists at $1.50 and $7.50.

Is Amazon Nova Micro or Mistral Medium 3.5 better for coding?

Mistral Medium 3.5 scores higher on coding benchmarks: 36.0 versus 30.5 in the Noometry coding category.

Which has the bigger context window?

Mistral Medium 3.5 does, with 262K tokens against 128K.

How many benchmarks do Amazon Nova Micro and Mistral Medium 3.5 share?

16 benchmarks have published results for both models. Amazon Nova Micro has 32 scored results on Noometry and Mistral Medium 3.5 has 22.

Related comparisons

Go deeper