Model comparison

Qwen Turbo vs Yi-Lightning

Yi-Lightning is the stronger model overall, scoring 37.1 to 27.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Qwen Turbo Alibaba (Qwen)

27.1

Rank #335 Reported

Yi-Lightning 01.AI

37.1

Rank #209 Confirmed

Summary

  • The widest gap is in math, where Yi-Lightning leads 36.2 to 15.3.

Side by side

Qwen Turbo and Yi-Lightning specifications
Qwen TurboYi-Lightning
ProviderAlibaba (Qwen)01.AI
Noometry Index27.137.1
Released2024-11-012024-12-02
WeightsProprietaryProprietary
Context window1M—
Max output16K—
Input $ / M tokens$0.05—
Output $ / M tokens$0.20—
Results tracked318

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Qwen Turbo: —, Yi-Lightning: 27.4 (#320)

Coding benchmarks
BenchmarkQwen TurboYi-Lightning
Aider Polyglot—12.9%
LMArena Coding—1312

Reasoning Not comparable

Qwen Turbo: —, Yi-Lightning: 25.9 (#139)

Reasoning benchmarks
BenchmarkQwen TurboYi-Lightning
LMArena Hard Prompts—1302

Math Yi-Lightning leads

Qwen Turbo: 15.3 (#297), Yi-Lightning: 36.2 (#172)

Math benchmarks
BenchmarkQwen TurboYi-Lightning
OTIS Mock AIME 2024-20256.1%—
LMArena Math—1300
MATH Level 556.2%—

Knowledge Yi-Lightning leads

Qwen Turbo: 22.2 (#272), Yi-Lightning: 35.4 (#185)

Knowledge benchmarks
BenchmarkQwen TurboYi-Lightning
GPQA Diamond41.8%—
LMArena Expert—1286

Multilingual Not comparable

Qwen Turbo: —, Yi-Lightning: 42.2 (#196)

Multilingual benchmarks
BenchmarkQwen TurboYi-Lightning
LMArena Non-English—1269
LMArena Chinese—1320
LMArena French—1305
LMArena German—1267
LMArena Japanese—1228
LMArena Korean—1192
LMArena Russian—1255
LMArena Spanish—1315

Instruction Following Not comparable

Qwen Turbo: —, Yi-Lightning: 67.4 (#196)

Instruction Following benchmarks
BenchmarkQwen TurboYi-Lightning
LMArena Instruction Following—1278

Long Context Not comparable

Qwen Turbo: —, Yi-Lightning: 39.4 (#181)

Long Context benchmarks
BenchmarkQwen TurboYi-Lightning
LMArena Longer Query—1297

Writing & Preference Not comparable

Qwen Turbo: —, Yi-Lightning: 50.2 (#184)

Writing & Preference benchmarks
BenchmarkQwen TurboYi-Lightning
LMArena Text—1302
LMArena Creative Writing—1280
LMArena Multi-Turn—1311

Frequently asked questions

Is Qwen Turbo better than Yi-Lightning?

Yi-Lightning is the stronger model overall, scoring 37.1 to 27.1 on the Noometry Index.

How many benchmarks do Qwen Turbo and Yi-Lightning share?

0 benchmarks have published results for both models. Qwen Turbo has 3 scored results on Noometry and Yi-Lightning has 18.

Related comparisons

Go deeper