Model comparison

Wizardlm 13b vs Yi-Lightning

Yi-Lightning is the stronger model overall, scoring 37.1 to 31.4 on the Noometry Index.

Last verified . 10 shared benchmarks.

Wizardlm 13b Microsoft

31.4

Rank #274 Confirmed

Yi-Lightning 01.AI

37.1

Rank #209 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Wizardlm 13b scores higher in 1 category and Yi-Lightning in 6 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Yi-Lightning leads 50.2 to 30.5.
  • Wizardlm 13b has downloadable open weights; the other is API-only.

Side by side

Wizardlm 13b and Yi-Lightning specifications
Wizardlm 13bYi-Lightning
ProviderMicrosoft01.AI
Noometry Index31.437.1
Released—2024-12-02
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1018

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Wizardlm 13b leads

Wizardlm 13b: 30.1 (#298), Yi-Lightning: 27.4 (#320)

Coding benchmarks
BenchmarkWizardlm 13bYi-Lightning
LMArena Coding10351312
Aider Polyglot—12.9%

Reasoning Yi-Lightning leads

Wizardlm 13b: 19.4 (#259), Yi-Lightning: 25.9 (#139)

Reasoning benchmarks
BenchmarkWizardlm 13bYi-Lightning
LMArena Hard Prompts10181302

Math Yi-Lightning leads

Wizardlm 13b: 30.2 (#238), Yi-Lightning: 36.2 (#172)

Math benchmarks
BenchmarkWizardlm 13bYi-Lightning
LMArena Math10171300

Knowledge Not comparable

Wizardlm 13b: —, Yi-Lightning: 35.4 (#185)

Knowledge benchmarks
BenchmarkWizardlm 13bYi-Lightning
LMArena Expert—1286

Multilingual Yi-Lightning leads

Wizardlm 13b: 27.1 (#277), Yi-Lightning: 42.2 (#196)

Multilingual benchmarks
BenchmarkWizardlm 13bYi-Lightning
LMArena Non-English10341269
LMArena Chinese10231320
LMArena French—1305
LMArena German—1267
LMArena Japanese—1228
LMArena Korean—1192
LMArena Russian—1255
LMArena Spanish—1315

Instruction Following Yi-Lightning leads

Wizardlm 13b: 53.5 (#285), Yi-Lightning: 67.4 (#196)

Instruction Following benchmarks
BenchmarkWizardlm 13bYi-Lightning
LMArena Instruction Following10481278

Long Context Yi-Lightning leads

Wizardlm 13b: 32.0 (#273), Yi-Lightning: 39.4 (#181)

Long Context benchmarks
BenchmarkWizardlm 13bYi-Lightning
LMArena Longer Query10541297

Writing & Preference Yi-Lightning leads

Wizardlm 13b: 30.5 (#287), Yi-Lightning: 50.2 (#184)

Writing & Preference benchmarks
BenchmarkWizardlm 13bYi-Lightning
LMArena Text10771302
LMArena Creative Writing10911280
LMArena Multi-Turn10471311

Frequently asked questions

Is Wizardlm 13b better than Yi-Lightning?

Yi-Lightning is the stronger model overall, scoring 37.1 to 31.4 on the Noometry Index.

Is Wizardlm 13b or Yi-Lightning better for coding?

Wizardlm 13b scores higher on coding benchmarks: 30.1 versus 27.4 in the Noometry coding category.

How many benchmarks do Wizardlm 13b and Yi-Lightning share?

10 benchmarks have published results for both models. Wizardlm 13b has 10 scored results on Noometry and Yi-Lightning has 18.

Related comparisons

Go deeper