Model comparison

Qwen2.5 72B Instruct vs Wizardlm 13b

Qwen2.5 72B Instruct and Wizardlm 13b score almost the same on the Noometry Index (31.9 vs 31.4), so choose on price, context window or the category you care about most.

Last verified . 10 shared benchmarks.

Qwen2.5 72B Instruct Alibaba (Qwen)

31.9

Rank #267 Confirmed

Wizardlm 13b Microsoft

31.4

Rank #274 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Qwen2.5 72B Instruct scores higher in 6 categories and Wizardlm 13b in 1 category; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen2.5 72B Instruct leads 46.7 to 30.5.

Side by side

Qwen2.5 72B Instruct and Wizardlm 13b specifications
Qwen2.5 72B InstructWizardlm 13b
ProviderAlibaba (Qwen)Microsoft
Noometry Index31.931.4
Released2024-09—
WeightsOpenOpen
Context window131K—
Max output8K—
Input $ / M tokens$1.40—
Output $ / M tokens$5.60—
Results tracked4310

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen2.5 72B Instruct leads

Qwen2.5 72B Instruct: 33.2 (#260), Wizardlm 13b: 30.1 (#298)

Coding benchmarks
BenchmarkQwen2.5 72B InstructWizardlm 13b
LMArena Coding12921035
WeirdML16%—
BigCodeBench Instruct45.8%—
BigCodeBench Complete55.9%—

Agentic & Tool Use Not comparable

Qwen2.5 72B Instruct: 22.1 (#133), Wizardlm 13b: —

Agentic & Tool Use benchmarks
BenchmarkQwen2.5 72B InstructWizardlm 13b
TheAgentCompany5.7%—
BALROG16.2%—
METR Time Horizons35.8%—

Reasoning Qwen2.5 72B Instruct leads

Qwen2.5 72B Instruct: 22.3 (#199), Wizardlm 13b: 19.4 (#259)

Reasoning benchmarks
BenchmarkQwen2.5 72B InstructWizardlm 13b
LMArena Hard Prompts12711018
DTBench62.9%—
LMCA13.4%—
BIG-Bench Hard79.8%—
Epoch Capabilities Index129—
ForecastBench57.5—
HellaSwag84.8%—
PIQA82.6%—
WinoGrande82.3%—

Math Wizardlm 13b leads

Qwen2.5 72B Instruct: 19.3 (#287), Wizardlm 13b: 30.2 (#238)

Math benchmarks
BenchmarkQwen2.5 72B InstructWizardlm 13b
LMArena Math12831017
OTIS Mock AIME 2024-20258.1%—
Omni-MATH33%—
MATH Level 563.2%—

Knowledge Not comparable

Qwen2.5 72B Instruct: 27.0 (#253), Wizardlm 13b: —

Knowledge benchmarks
BenchmarkQwen2.5 72B InstructWizardlm 13b
GPQA Diamond49.1%—
MMLU-Pro63.1%—
Confabulations19.1%—
GPQA (HELM)42.6%—
LMArena Expert1245—
ARC (AI2) Challenge94.5%—
MMLU85.3%—
TriviaQA71.9%—

Multilingual Qwen2.5 72B Instruct leads

Qwen2.5 72B Instruct: 41.0 (#213), Wizardlm 13b: 27.1 (#277)

Multilingual benchmarks
BenchmarkQwen2.5 72B InstructWizardlm 13b
LMArena Non-English12521034
LMArena Chinese12721023
LMArena French1280—
LMArena German1234—
LMArena Japanese1180—
LMArena Korean1188—
LMArena Russian1264—
LMArena Spanish1256—

Instruction Following Qwen2.5 72B Instruct leads

Qwen2.5 72B Instruct: 65.5 (#221), Wizardlm 13b: 53.5 (#285)

Instruction Following benchmarks
BenchmarkQwen2.5 72B InstructWizardlm 13b
LMArena Instruction Following12541048
IFEval80.6%—

Long Context Qwen2.5 72B Instruct leads

Qwen2.5 72B Instruct: 38.9 (#188), Wizardlm 13b: 32.0 (#273)

Long Context benchmarks
BenchmarkQwen2.5 72B InstructWizardlm 13b
LMArena Longer Query12821054

Writing & Preference Qwen2.5 72B Instruct leads

Qwen2.5 72B Instruct: 46.7 (#215), Wizardlm 13b: 30.5 (#287)

Writing & Preference benchmarks
BenchmarkQwen2.5 72B InstructWizardlm 13b
LMArena Text12691077
LMArena Creative Writing12211091
LMArena Multi-Turn12721047
WildBench80.2%—

Frequently asked questions

Is Qwen2.5 72B Instruct better than Wizardlm 13b?

Qwen2.5 72B Instruct and Wizardlm 13b score almost the same on the Noometry Index (31.9 vs 31.4), so choose on price, context window or the category you care about most.

Is Qwen2.5 72B Instruct or Wizardlm 13b better for coding?

Qwen2.5 72B Instruct scores higher on coding benchmarks: 33.2 versus 30.1 in the Noometry coding category.

How many benchmarks do Qwen2.5 72B Instruct and Wizardlm 13b share?

10 benchmarks have published results for both models. Qwen2.5 72B Instruct has 43 scored results on Noometry and Wizardlm 13b has 10.

Related comparisons

Go deeper