Model comparison

Wizardlm 70b vs Yi-Lightning

Yi-Lightning is the stronger model overall, scoring 37.1 to 33.0 on the Noometry Index.

Last verified . 12 shared benchmarks.

Wizardlm 70b Microsoft

33.0

Rank #249 Confirmed

Yi-Lightning 01.AI

37.1

Rank #209 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Wizardlm 70b scores higher in 1 category and Yi-Lightning in 6 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Yi-Lightning leads 50.2 to 34.8.
  • Wizardlm 70b has downloadable open weights; the other is API-only.

Side by side

Wizardlm 70b and Yi-Lightning specifications
Wizardlm 70bYi-Lightning
ProviderMicrosoft01.AI
Noometry Index33.037.1
Released—2024-12-02
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1218

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Wizardlm 70b leads

Wizardlm 70b: 31.4 (#285), Yi-Lightning: 27.4 (#320)

Coding benchmarks
BenchmarkWizardlm 70bYi-Lightning
LMArena Coding10811312
Aider Polyglot—12.9%

Reasoning Yi-Lightning leads

Wizardlm 70b: 20.7 (#234), Yi-Lightning: 25.9 (#139)

Reasoning benchmarks
BenchmarkWizardlm 70bYi-Lightning
LMArena Hard Prompts10791302

Math Yi-Lightning leads

Wizardlm 70b: 32.2 (#218), Yi-Lightning: 36.2 (#172)

Math benchmarks
BenchmarkWizardlm 70bYi-Lightning
LMArena Math11161300

Knowledge Not comparable

Wizardlm 70b: —, Yi-Lightning: 35.4 (#185)

Knowledge benchmarks
BenchmarkWizardlm 70bYi-Lightning
LMArena Expert—1286

Multilingual Yi-Lightning leads

Wizardlm 70b: 29.6 (#265), Yi-Lightning: 42.2 (#196)

Multilingual benchmarks
BenchmarkWizardlm 70bYi-Lightning
LMArena Non-English10781269
LMArena Chinese10521320
LMArena German10831267
LMArena Russian11551255
LMArena French—1305
LMArena Japanese—1228
LMArena Korean—1192
LMArena Spanish—1315

Instruction Following Yi-Lightning leads

Wizardlm 70b: 56.3 (#273), Yi-Lightning: 67.4 (#196)

Instruction Following benchmarks
BenchmarkWizardlm 70bYi-Lightning
LMArena Instruction Following10931278

Long Context Yi-Lightning leads

Wizardlm 70b: 33.3 (#263), Yi-Lightning: 39.4 (#181)

Long Context benchmarks
BenchmarkWizardlm 70bYi-Lightning
LMArena Longer Query10971297

Writing & Preference Yi-Lightning leads

Wizardlm 70b: 34.8 (#269), Yi-Lightning: 50.2 (#184)

Writing & Preference benchmarks
BenchmarkWizardlm 70bYi-Lightning
LMArena Text11201302
LMArena Creative Writing11491280
LMArena Multi-Turn11081311

Frequently asked questions

Is Wizardlm 70b better than Yi-Lightning?

Yi-Lightning is the stronger model overall, scoring 37.1 to 33.0 on the Noometry Index.

Is Wizardlm 70b or Yi-Lightning better for coding?

Wizardlm 70b scores higher on coding benchmarks: 31.4 versus 27.4 in the Noometry coding category.

How many benchmarks do Wizardlm 70b and Yi-Lightning share?

12 benchmarks have published results for both models. Wizardlm 70b has 12 scored results on Noometry and Yi-Lightning has 18.

Related comparisons

Go deeper