Model comparison

Qwen1.5-110B vs Wizardlm 13b

Qwen1.5-110B is the stronger model overall, scoring 34.2 to 31.4 on the Noometry Index.

Last verified . 10 shared benchmarks.

Qwen1.5-110B Alibaba (Qwen)

34.2

Rank #234 Confirmed

Wizardlm 13b Microsoft

31.4

Rank #274 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Qwen1.5-110B scores higher in 7 categories and Wizardlm 13b in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen1.5-110B leads 38.0 to 30.5.

Side by side

Qwen1.5-110B and Wizardlm 13b specifications
Qwen1.5-110BWizardlm 13b
ProviderAlibaba (Qwen)Microsoft
Noometry Index34.231.4
Released2024-04-25—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2010

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen1.5-110B leads

Qwen1.5-110B: 33.0 (#264), Wizardlm 13b: 30.1 (#298)

Coding benchmarks
BenchmarkQwen1.5-110BWizardlm 13b
LMArena Coding11841035
BigCodeBench Instruct35%—
BigCodeBench Complete44.4%—

Reasoning Qwen1.5-110B leads

Qwen1.5-110B: 22.7 (#189), Wizardlm 13b: 19.4 (#259)

Reasoning benchmarks
BenchmarkQwen1.5-110BWizardlm 13b
LMArena Hard Prompts11681018
ForecastBench57.7—

Math Qwen1.5-110B leads

Qwen1.5-110B: 33.7 (#201), Wizardlm 13b: 30.2 (#238)

Math benchmarks
BenchmarkQwen1.5-110BWizardlm 13b
LMArena Math11851017

Knowledge Not comparable

Qwen1.5-110B: 31.2 (#219), Wizardlm 13b: —

Knowledge benchmarks
BenchmarkQwen1.5-110BWizardlm 13b
LMArena Expert1144—

Multilingual Qwen1.5-110B leads

Qwen1.5-110B: 33.6 (#250), Wizardlm 13b: 27.1 (#277)

Multilingual benchmarks
BenchmarkQwen1.5-110BWizardlm 13b
LMArena Non-English11421034
LMArena Chinese12061023
LMArena French1151—
LMArena German1123—
LMArena Japanese1074—
LMArena Korean1044—
LMArena Russian1118—
LMArena Spanish1142—

Instruction Following Qwen1.5-110B leads

Qwen1.5-110B: 60.3 (#252), Wizardlm 13b: 53.5 (#285)

Instruction Following benchmarks
BenchmarkQwen1.5-110BWizardlm 13b
LMArena Instruction Following11581048

Long Context Qwen1.5-110B leads

Qwen1.5-110B: 35.1 (#242), Wizardlm 13b: 32.0 (#273)

Long Context benchmarks
BenchmarkQwen1.5-110BWizardlm 13b
LMArena Longer Query11571054

Writing & Preference Qwen1.5-110B leads

Qwen1.5-110B: 38.0 (#255), Wizardlm 13b: 30.5 (#287)

Writing & Preference benchmarks
BenchmarkQwen1.5-110BWizardlm 13b
LMArena Text11751077
LMArena Creative Writing11481091
LMArena Multi-Turn11601047

Frequently asked questions

Is Qwen1.5-110B better than Wizardlm 13b?

Qwen1.5-110B is the stronger model overall, scoring 34.2 to 31.4 on the Noometry Index.

Is Qwen1.5-110B or Wizardlm 13b better for coding?

Qwen1.5-110B scores higher on coding benchmarks: 33.0 versus 30.1 in the Noometry coding category.

How many benchmarks do Qwen1.5-110B and Wizardlm 13b share?

10 benchmarks have published results for both models. Qwen1.5-110B has 20 scored results on Noometry and Wizardlm 13b has 10.

Related comparisons

Go deeper