Model comparison

Amazon Nova Pro vs Magistral Medium

Magistral Medium is the stronger model overall, scoring 35.2 to 31.0 on the Noometry Index. Amazon Nova Pro costs 2.0× less per token, which makes it the better buy when Magistral Medium's lead doesn't matter for your workload.

Last verified . 17 shared benchmarks.

Amazon Nova Pro Amazon

31.0

Rank #281 Confirmed

Magistral Medium Mistral AI

35.2

Rank #227 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Amazon Nova Pro scores higher in 2 categories and Magistral Medium in 6 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Amazon Nova Pro leads 20.0 to 8.6.
  • Amazon Nova Pro is cheaper at $0.80 / $3.20 per million input/output tokens, against $2 / $5 for Magistral Medium.
  • Amazon Nova Pro accepts more context: 300K tokens versus 262K.
  • Magistral Medium has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Pro and Magistral Medium specifications
Amazon Nova ProMagistral Medium
ProviderAmazonMistral AI
Noometry Index31.035.2
Released2024-12-032025-03-17
WeightsProprietaryOpen
Context window300K262K
Max output10K16K
Input $ / M tokens$0.80$2
Output $ / M tokens$3.20$5
Results tracked3822

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Magistral Medium leads

Amazon Nova Pro: 35.1 (#229), Magistral Medium: 39.1 (#161)

Coding benchmarks
BenchmarkAmazon Nova ProMagistral Medium
LMArena Coding12701319
SciCode—39.2%
LiveBench Coding38.1%—

Agentic & Tool Use Not comparable

Amazon Nova Pro: 16.7 (#147), Magistral Medium: —

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova ProMagistral Medium
Berkeley Function Calling Leaderboard25%—
TheAgentCompany1.7%—

Reasoning Amazon Nova Pro leads

Amazon Nova Pro: 20.0 (#243), Magistral Medium: 8.6 (#348)

Reasoning benchmarks
BenchmarkAmazon Nova ProMagistral Medium
LMArena Hard Prompts12461267
ARC-AGI-2—0%
Kagi LLM Benchmark—16.2%
ARC-AGI-1—6.1%
CritPt—0.3%
LiveBench Reasoning32.6%—
LiveBench Data Analysis48.3%—
Epoch Capabilities Index123.8—
LiveBench43.5%—

Math Magistral Medium leads

Amazon Nova Pro: 28.5 (#243), Magistral Medium: 35.1 (#189)

Math benchmarks
BenchmarkAmazon Nova ProMagistral Medium
LMArena Math12521250
Omni-MATH24.2%—
LiveBench Math38%—

Knowledge Magistral Medium leads

Amazon Nova Pro: 27.4 (#250), Magistral Medium: 33.5 (#202)

Knowledge benchmarks
BenchmarkAmazon Nova ProMagistral Medium
LMArena Expert12111223
Humanity's Last Exam4.4%—
MMLU-Pro67.3%—
Confabulations30.1%—
Vectara Hallucination Rate5.1%—
GPQA (HELM)44.6%—
MMLU82%—

Multimodal Not comparable

Amazon Nova Pro: 25.0 (#126), Magistral Medium: —

Multimodal benchmarks
BenchmarkAmazon Nova ProMagistral Medium
LMArena Vision980—

Multilingual Too close to call

Amazon Nova Pro: 39.7 (#223), Magistral Medium: 39.6 (#224)

Multilingual benchmarks
BenchmarkAmazon Nova ProMagistral Medium
LMArena Non-English12341232
LMArena Chinese12441227
LMArena French12711267
LMArena German12431248
LMArena Japanese12001175
LMArena Korean12031125
LMArena Russian12401224
LMArena Spanish11821271

Instruction Following Magistral Medium leads

Amazon Nova Pro: 64.9 (#226), Magistral Medium: 66.0 (#211)

Instruction Following benchmarks
BenchmarkAmazon Nova ProMagistral Medium
LMArena Instruction Following12351254
LiveBench Instruction Following67.1%—
IFEval81.5%—

Long Context Magistral Medium leads

Amazon Nova Pro: 38.1 (#205), Magistral Medium: 39.3 (#183)

Long Context benchmarks
BenchmarkAmazon Nova ProMagistral Medium
LMArena Longer Query12551295

Writing & Preference Magistral Medium leads

Amazon Nova Pro: 43.9 (#226), Magistral Medium: 46.3 (#219)

Writing & Preference benchmarks
BenchmarkAmazon Nova ProMagistral Medium
LMArena Text12591255
LMArena Creative Writing12121245
LMArena Multi-Turn12461275
Short-Story Creative Writing60.5%—
WildBench77.7%—
LiveBench Language37%—

Frequently asked questions

Is Amazon Nova Pro better than Magistral Medium?

Magistral Medium is the stronger model overall, scoring 35.2 to 31.0 on the Noometry Index. Amazon Nova Pro costs 2.0× less per token, which makes it the better buy when Magistral Medium's lead doesn't matter for your workload.

Which is cheaper, Amazon Nova Pro or Magistral Medium?

Amazon Nova Pro is cheaper. It lists at $0.80 per million input tokens and $3.20 per million output tokens; Magistral Medium lists at $2 and $5.

Is Amazon Nova Pro or Magistral Medium better for coding?

Magistral Medium scores higher on coding benchmarks: 39.1 versus 35.1 in the Noometry coding category.

Which has the bigger context window?

Amazon Nova Pro does, with 300K tokens against 262K.

How many benchmarks do Amazon Nova Pro and Magistral Medium share?

17 benchmarks have published results for both models. Amazon Nova Pro has 38 scored results on Noometry and Magistral Medium has 22.

Related comparisons

Go deeper