Noometry

Model comparison

Amazon Nova Pro vs Qwen2.5-Max

Qwen2.5-Max is the stronger model overall, scoring 40.7 to 31.0 on the Noometry Index.

Last verified . 27 shared benchmarks.

Amazon Nova Pro Amazon

31.0

Rank #281 Confirmed

Qwen2.5-Max Alibaba (Qwen)

40.7

Rank #146 Confirmed

Summary

  • They share 27 benchmarks with published results for both. Amazon Nova Pro scores higher in 0 categories and Qwen2.5-Max in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen2.5-Max leads 55.4 to 43.9.
  • The biggest single-benchmark swing is LiveBench Coding: 38.1% for Amazon Nova Pro and 64.4% for Qwen2.5-Max.

Side by side

Amazon Nova ProQwen2.5-Max
ProviderAmazonAlibaba (Qwen)
Noometry Index31.040.7
Released2024-12-032025-01-25
WeightsProprietaryProprietary
Context window300K—
Max output10K—
Input $ / M tokens$0.80—
Output $ / M tokens$3.20—
Results tracked3827

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen2.5-Max leads

Amazon Nova Pro: 35.1 (#229), Qwen2.5-Max: 41.8 (#117)

BenchmarkAmazon Nova ProQwen2.5-Max
LiveBench Coding38.1%64.4%
LMArena Coding12701359

Agentic & Tool Use Not comparable

Amazon Nova Pro: 16.7 (#147), Qwen2.5-Max: —

BenchmarkAmazon Nova ProQwen2.5-Max
Berkeley Function Calling Leaderboard25%—
TheAgentCompany1.7%—

Reasoning Qwen2.5-Max leads

Amazon Nova Pro: 20.0 (#243), Qwen2.5-Max: 25.6 (#147)

BenchmarkAmazon Nova ProQwen2.5-Max
LiveBench Reasoning32.6%51.4%
LMArena Hard Prompts12461360
LiveBench Data Analysis48.3%67.9%
Epoch Capabilities Index123.8132.53
LiveBench43.5%62.3%

Math Qwen2.5-Max leads

Amazon Nova Pro: 28.5 (#243), Qwen2.5-Max: 36.9 (#162)

BenchmarkAmazon Nova ProQwen2.5-Max
LiveBench Math38%58.4%
LMArena Math12521369
Omni-MATH24.2%—

Knowledge Qwen2.5-Max leads

Amazon Nova Pro: 27.4 (#250), Qwen2.5-Max: 35.3 (#186)

BenchmarkAmazon Nova ProQwen2.5-Max
Confabulations30.1%21.8%
LMArena Expert12111337
Humanity's Last Exam4.4%—
MMLU-Pro67.3%—
Vectara Hallucination Rate5.1%—
GPQA (HELM)44.6%—
MMLU82%—

Multimodal Not comparable

Amazon Nova Pro: 25.0 (#126), Qwen2.5-Max: —

BenchmarkAmazon Nova ProQwen2.5-Max
LMArena Vision980—

Multilingual Qwen2.5-Max leads

Amazon Nova Pro: 39.7 (#223), Qwen2.5-Max: 48.1 (#146)

BenchmarkAmazon Nova ProQwen2.5-Max
LMArena Non-English12341352
LMArena Chinese12441382
LMArena French12711396
LMArena German12431350
LMArena Japanese12001300
LMArena Korean12031304
LMArena Russian12401353
LMArena Spanish11821377

Instruction Following Qwen2.5-Max leads

Amazon Nova Pro: 64.9 (#226), Qwen2.5-Max: 71.3 (#152)

BenchmarkAmazon Nova ProQwen2.5-Max
LiveBench Instruction Following67.1%75.3%
LMArena Instruction Following12351335
IFEval81.5%—

Long Context Qwen2.5-Max leads

Amazon Nova Pro: 38.1 (#205), Qwen2.5-Max: 41.4 (#142)

BenchmarkAmazon Nova ProQwen2.5-Max
LMArena Longer Query12551358

Writing & Preference Qwen2.5-Max leads

Amazon Nova Pro: 43.9 (#226), Qwen2.5-Max: 55.4 (#146)

BenchmarkAmazon Nova ProQwen2.5-Max
LMArena Text12591367
LMArena Creative Writing12121339
Short-Story Creative Writing60.5%72.9%
LMArena Multi-Turn12461364
LiveBench Language37%56.3%
WildBench77.7%—

Frequently asked questions

Is Amazon Nova Pro better than Qwen2.5-Max?

Qwen2.5-Max is the stronger model overall, scoring 40.7 to 31.0 on the Noometry Index.

Is Amazon Nova Pro or Qwen2.5-Max better for coding?

Qwen2.5-Max scores higher on coding benchmarks: 41.8 versus 35.1 in the Noometry coding category.

How many benchmarks do Amazon Nova Pro and Qwen2.5-Max share?

27 benchmarks have published results for both models. Amazon Nova Pro has 38 scored results on Noometry and Qwen2.5-Max has 27.

Related comparisons

Go deeper