Model comparison

Amazon Nova Pro vs Wizardlm 13b

Amazon Nova Pro and Wizardlm 13b score almost the same on the Noometry Index (31.0 vs 31.4), so choose on price, context window or the category you care about most.

Last verified . 10 shared benchmarks.

Amazon Nova Pro Amazon

31.0

Rank #281 Confirmed

Wizardlm 13b Microsoft

31.4

Rank #274 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Amazon Nova Pro scores higher in 6 categories and Wizardlm 13b in 1 category; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Amazon Nova Pro leads 43.9 to 30.5.
  • Wizardlm 13b has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Pro and Wizardlm 13b specifications
Amazon Nova ProWizardlm 13b
ProviderAmazonMicrosoft
Noometry Index31.031.4
Released2024-12-03—
WeightsProprietaryOpen
Context window300K—
Max output10K—
Input $ / M tokens$0.80—
Output $ / M tokens$3.20—
Results tracked3810

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Pro leads

Amazon Nova Pro: 35.1 (#229), Wizardlm 13b: 30.1 (#298)

Coding benchmarks
BenchmarkAmazon Nova ProWizardlm 13b
LMArena Coding12701035
LiveBench Coding38.1%—

Agentic & Tool Use Not comparable

Amazon Nova Pro: 16.7 (#147), Wizardlm 13b: —

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova ProWizardlm 13b
Berkeley Function Calling Leaderboard25%—
TheAgentCompany1.7%—

Reasoning Too close to call

Amazon Nova Pro: 20.0 (#243), Wizardlm 13b: 19.4 (#259)

Reasoning benchmarks
BenchmarkAmazon Nova ProWizardlm 13b
LMArena Hard Prompts12461018
LiveBench Reasoning32.6%—
LiveBench Data Analysis48.3%—
Epoch Capabilities Index123.8—
LiveBench43.5%—

Math Wizardlm 13b leads

Amazon Nova Pro: 28.5 (#243), Wizardlm 13b: 30.2 (#238)

Math benchmarks
BenchmarkAmazon Nova ProWizardlm 13b
LMArena Math12521017
Omni-MATH24.2%—
LiveBench Math38%—

Knowledge Not comparable

Amazon Nova Pro: 27.4 (#250), Wizardlm 13b: —

Knowledge benchmarks
BenchmarkAmazon Nova ProWizardlm 13b
Humanity's Last Exam4.4%—
MMLU-Pro67.3%—
Confabulations30.1%—
Vectara Hallucination Rate5.1%—
GPQA (HELM)44.6%—
LMArena Expert1211—
MMLU82%—

Multimodal Not comparable

Amazon Nova Pro: 25.0 (#126), Wizardlm 13b: —

Multimodal benchmarks
BenchmarkAmazon Nova ProWizardlm 13b
LMArena Vision980—

Multilingual Amazon Nova Pro leads

Amazon Nova Pro: 39.7 (#223), Wizardlm 13b: 27.1 (#277)

Multilingual benchmarks
BenchmarkAmazon Nova ProWizardlm 13b
LMArena Non-English12341034
LMArena Chinese12441023
LMArena French1271—
LMArena German1243—
LMArena Japanese1200—
LMArena Korean1203—
LMArena Russian1240—
LMArena Spanish1182—

Instruction Following Amazon Nova Pro leads

Amazon Nova Pro: 64.9 (#226), Wizardlm 13b: 53.5 (#285)

Instruction Following benchmarks
BenchmarkAmazon Nova ProWizardlm 13b
LMArena Instruction Following12351048
LiveBench Instruction Following67.1%—
IFEval81.5%—

Long Context Amazon Nova Pro leads

Amazon Nova Pro: 38.1 (#205), Wizardlm 13b: 32.0 (#273)

Long Context benchmarks
BenchmarkAmazon Nova ProWizardlm 13b
LMArena Longer Query12551054

Writing & Preference Amazon Nova Pro leads

Amazon Nova Pro: 43.9 (#226), Wizardlm 13b: 30.5 (#287)

Writing & Preference benchmarks
BenchmarkAmazon Nova ProWizardlm 13b
LMArena Text12591077
LMArena Creative Writing12121091
LMArena Multi-Turn12461047
Short-Story Creative Writing60.5%—
WildBench77.7%—
LiveBench Language37%—

Frequently asked questions

Is Amazon Nova Pro better than Wizardlm 13b?

Amazon Nova Pro and Wizardlm 13b score almost the same on the Noometry Index (31.0 vs 31.4), so choose on price, context window or the category you care about most.

Is Amazon Nova Pro or Wizardlm 13b better for coding?

Amazon Nova Pro scores higher on coding benchmarks: 35.1 versus 30.1 in the Noometry coding category.

How many benchmarks do Amazon Nova Pro and Wizardlm 13b share?

10 benchmarks have published results for both models. Amazon Nova Pro has 38 scored results on Noometry and Wizardlm 13b has 10.

Related comparisons

Go deeper