Model comparison

Amazon Nova Pro vs Pixtral Large

Pixtral Large is the stronger model overall, scoring 31.7 to 30.5 on the Noometry Index. Amazon Nova Pro costs 2.1× less per token, which makes it the better buy when Pixtral Large's lead doesn't matter for your workload.

Last verified . 1 shared benchmarks.

Amazon Nova Pro Amazon

30.5

Rank #278 Confirmed

Pixtral Large Mistral AI

31.7

Rank #257 Reported

Summary

  • They share 1 benchmark with published results for both. Amazon Nova Pro scores higher in 1 category and Pixtral Large in 2 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Pro leads 44.1 to 32.9.
  • Amazon Nova Pro is cheaper at $0.80 / $3.20 per million input/output tokens, against $2 / $6 for Pixtral Large.
  • Amazon Nova Pro accepts more context: 300K tokens versus 128K.
  • Pixtral Large has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Pro and Pixtral Large specifications
Amazon Nova ProPixtral Large
ProviderAmazonMistral AI
Noometry Index30.531.7
Released2024-12-032024-11-01
WeightsProprietaryOpen
Context window300K128K
Max output10K128K
Input $ / M tokens$0.80$2
Output $ / M tokens$3.20$6
Results tracked383

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Amazon Nova Pro: 34.6 (#224), Pixtral Large: —

Coding benchmarks
BenchmarkAmazon Nova ProPixtral Large
LiveBench Coding38.1%—
LMArena Coding1270—

Agentic & Tool Use Not comparable

Amazon Nova Pro: 16.6 (#139), Pixtral Large: —

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova ProPixtral Large
Berkeley Function Calling Leaderboard25%—
TheAgentCompany1.7%—

Reasoning Pixtral Large leads

Amazon Nova Pro: 19.2 (#240), Pixtral Large: 20.9 (#208)

Reasoning benchmarks
BenchmarkAmazon Nova ProPixtral Large
EnigmaEval—0.8%
LiveBench Reasoning32.6%—
LMArena Hard Prompts1246—
LiveBench Data Analysis48.3%—
Epoch Capabilities Index123.75—
LiveBench43.5%—

Math Not comparable

Amazon Nova Pro: 26.4 (#240), Pixtral Large: —

Math benchmarks
BenchmarkAmazon Nova ProPixtral Large
Omni-MATH24.2%—
LiveBench Math38%—
LMArena Math1252—

Knowledge Not comparable

Amazon Nova Pro: 27.1 (#246), Pixtral Large: —

Knowledge benchmarks
BenchmarkAmazon Nova ProPixtral Large
Humanity's Last Exam4.4%—
MMLU-Pro67.3%—
Confabulations30.1%—
Vectara Hallucination Rate5.1%—
GPQA (HELM)44.6%—
LMArena Expert1211—
MMLU82%—

Multimodal Pixtral Large leads

Amazon Nova Pro: 24.5 (#121), Pixtral Large: 30.0 (#105)

Multimodal benchmarks
BenchmarkAmazon Nova ProPixtral Large
LMArena Vision9801089

Multilingual Not comparable

Amazon Nova Pro: 39.9 (#218), Pixtral Large: —

Multilingual benchmarks
BenchmarkAmazon Nova ProPixtral Large
LMArena Non-English1234—
LMArena Chinese1244—
LMArena French1270—
LMArena German1243—
LMArena Japanese1200—
LMArena Korean1203—
LMArena Russian1240—
LMArena Spanish1182—

Instruction Following Not comparable

Amazon Nova Pro: 65.1 (#221), Pixtral Large: —

Instruction Following benchmarks
BenchmarkAmazon Nova ProPixtral Large
LiveBench Instruction Following67.1%—
IFEval81.5%—
LMArena Instruction Following1235—

Long Context Not comparable

Amazon Nova Pro: 38.1 (#199), Pixtral Large: —

Long Context benchmarks
BenchmarkAmazon Nova ProPixtral Large
LMArena Longer Query1255—

Writing & Preference Amazon Nova Pro leads

Amazon Nova Pro: 44.1 (#221), Pixtral Large: 32.9 (#273)

Writing & Preference benchmarks
BenchmarkAmazon Nova ProPixtral Large
LMArena Text1259—
LMArena Creative Writing1212—
Short-Story Creative Writing60.5%—
EQ-Bench Creative Writing—988
WildBench77.7%—
LMArena Multi-Turn1245—
LiveBench Language37%—

Frequently asked questions

Is Amazon Nova Pro better than Pixtral Large?

Pixtral Large is the stronger model overall, scoring 31.7 to 30.5 on the Noometry Index. Amazon Nova Pro costs 2.1× less per token, which makes it the better buy when Pixtral Large's lead doesn't matter for your workload.

Which is cheaper, Amazon Nova Pro or Pixtral Large?

Amazon Nova Pro is cheaper. It lists at $0.80 per million input tokens and $3.20 per million output tokens; Pixtral Large lists at $2 and $6.

Which has the bigger context window?

Amazon Nova Pro does, with 300K tokens against 128K.

How many benchmarks do Amazon Nova Pro and Pixtral Large share?

1 benchmark has published results for both models. Amazon Nova Pro has 38 scored results on Noometry and Pixtral Large has 3.

Related comparisons

Go deeper