Model comparison

Amazon Nova Pro vs Qwen2-72B

Amazon Nova Pro and Qwen2-72B score almost the same on the Noometry Index (31.0 vs 30.0), so choose on price, context window or the category you care about most.

Last verified . 20 shared benchmarks.

Amazon Nova Pro Amazon

31.0

Rank #281 Confirmed

Qwen2-72B Alibaba (Qwen)

30.0

Rank #300 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Amazon Nova Pro scores higher in 6 categories and Qwen2-72B in 3 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Amazon Nova Pro leads 27.4 to 21.2.
  • Qwen2-72B has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Pro and Qwen2-72B specifications
Amazon Nova ProQwen2-72B
ProviderAmazonAlibaba (Qwen)
Noometry Index31.030.0
Released2024-12-032024-06-07
WeightsProprietaryOpen
Context window300K—
Max output10K—
Input $ / M tokens$0.80—
Output $ / M tokens$3.20—
Results tracked3826

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Pro leads

Amazon Nova Pro: 35.1 (#229), Qwen2-72B: 29.1 (#310)

Coding benchmarks
BenchmarkAmazon Nova ProQwen2-72B
LMArena Coding12701196
WeirdML—11.3%
BigCodeBench Instruct—38.5%
LiveBench Coding38.1%—
BigCodeBench Complete—54%

Agentic & Tool Use Too close to call

Amazon Nova Pro: 16.7 (#147), Qwen2-72B: 17.0 (#146)

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova ProQwen2-72B
TheAgentCompany1.7%1.1%
Berkeley Function Calling Leaderboard25%—
METR Time Horizons—29.9%

Reasoning Qwen2-72B leads

Amazon Nova Pro: 20.0 (#243), Qwen2-72B: 23.2 (#181)

Reasoning benchmarks
BenchmarkAmazon Nova ProQwen2-72B
LMArena Hard Prompts12461191
Epoch Capabilities Index123.8125.28
LiveBench Reasoning32.6%—
LiveBench Data Analysis48.3%—
LiveBench43.5%—

Math Qwen2-72B leads

Amazon Nova Pro: 28.5 (#243), Qwen2-72B: 30.2 (#236)

Math benchmarks
BenchmarkAmazon Nova ProQwen2-72B
LMArena Math12521235
Omni-MATH24.2%—
LiveBench Math38%—
MATH Level 5—39.1%

Knowledge Amazon Nova Pro leads

Amazon Nova Pro: 27.4 (#250), Qwen2-72B: 21.2 (#275)

Knowledge benchmarks
BenchmarkAmazon Nova ProQwen2-72B
LMArena Expert12111171
MMLU82%82.4%
GPQA Diamond—40.8%
Humanity's Last Exam4.4%—
MMLU-Pro67.3%—
Confabulations30.1%—
Vectara Hallucination Rate5.1%—
GPQA (HELM)44.6%—

Multimodal Not comparable

Amazon Nova Pro: 25.0 (#126), Qwen2-72B: —

Multimodal benchmarks
BenchmarkAmazon Nova ProQwen2-72B
LMArena Vision980—

Multilingual Amazon Nova Pro leads

Amazon Nova Pro: 39.7 (#223), Qwen2-72B: 35.9 (#244)

Multilingual benchmarks
BenchmarkAmazon Nova ProQwen2-72B
LMArena Non-English12341176
LMArena Chinese12441240
LMArena French12711170
LMArena German12431151
LMArena Japanese12001111
LMArena Korean12031083
LMArena Russian12401169
LMArena Spanish11821169

Instruction Following Amazon Nova Pro leads

Amazon Nova Pro: 64.9 (#226), Qwen2-72B: 61.7 (#241)

Instruction Following benchmarks
BenchmarkAmazon Nova ProQwen2-72B
LMArena Instruction Following12351181
LiveBench Instruction Following67.1%—
IFEval81.5%—

Long Context Amazon Nova Pro leads

Amazon Nova Pro: 38.1 (#205), Qwen2-72B: 36.1 (#235)

Long Context benchmarks
BenchmarkAmazon Nova ProQwen2-72B
LMArena Longer Query12551192

Writing & Preference Amazon Nova Pro leads

Amazon Nova Pro: 43.9 (#226), Qwen2-72B: 40.8 (#241)

Writing & Preference benchmarks
BenchmarkAmazon Nova ProQwen2-72B
LMArena Text12591203
LMArena Creative Writing12121181
LMArena Multi-Turn12461196
Short-Story Creative Writing60.5%—
WildBench77.7%—
LiveBench Language37%—

Frequently asked questions

Is Amazon Nova Pro better than Qwen2-72B?

Amazon Nova Pro and Qwen2-72B score almost the same on the Noometry Index (31.0 vs 30.0), so choose on price, context window or the category you care about most.

Is Amazon Nova Pro or Qwen2-72B better for coding?

Amazon Nova Pro scores higher on coding benchmarks: 35.1 versus 29.1 in the Noometry coding category.

How many benchmarks do Amazon Nova Pro and Qwen2-72B share?

20 benchmarks have published results for both models. Amazon Nova Pro has 38 scored results on Noometry and Qwen2-72B has 26.

Related comparisons

Go deeper