Model comparison

Qwen Turbo vs Yi-1.5-34B

Yi-1.5-34B is the stronger model overall, scoring 30.6 to 27.1 on the Noometry Index.

Last verified . 2 shared benchmarks.

Qwen Turbo Alibaba (Qwen)

27.1

Rank #335 Reported

Yi-1.5-34B 01.AI

30.6

Rank #289 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Qwen Turbo scores higher in 1 category and Yi-1.5-34B in 1 category; 2 gaps are clear of the uncertainty.
  • The widest gap is in math, where Yi-1.5-34B leads 27.5 to 15.3.
  • The biggest single-benchmark swing is MATH Level 5: 56.2% for Qwen Turbo and 25.5% for Yi-1.5-34B.
  • Yi-1.5-34B has downloadable open weights; the other is API-only.

Side by side

Qwen Turbo and Yi-1.5-34B specifications
Qwen TurboYi-1.5-34B
ProviderAlibaba (Qwen)01.AI
Noometry Index27.130.6
Released2024-11-012024-05-13
WeightsProprietaryOpen
Context window1M—
Max output16K—
Input $ / M tokens$0.05—
Output $ / M tokens$0.20—
Results tracked321

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Qwen Turbo: —, Yi-1.5-34B: 32.4 (#272)

Coding benchmarks
BenchmarkQwen TurboYi-1.5-34B
BigCodeBench Instruct—33.9%
LMArena Coding—1169
BigCodeBench Complete—43.8%

Reasoning Not comparable

Qwen Turbo: —, Yi-1.5-34B: 22.5 (#191)

Reasoning benchmarks
BenchmarkQwen TurboYi-1.5-34B
LMArena Hard Prompts—1160

Math Yi-1.5-34B leads

Qwen Turbo: 15.3 (#297), Yi-1.5-34B: 27.5 (#249)

Math benchmarks
BenchmarkQwen TurboYi-1.5-34B
MATH Level 556.2%25.5%
OTIS Mock AIME 2024-20256.1%—
LMArena Math—1182

Knowledge Qwen Turbo leads

Qwen Turbo: 22.2 (#272), Yi-1.5-34B: 14.8 (#295)

Knowledge benchmarks
BenchmarkQwen TurboYi-1.5-34B
GPQA Diamond41.8%32%
LMArena Expert—1144

Multilingual Not comparable

Qwen Turbo: —, Yi-1.5-34B: 32.3 (#256)

Multilingual benchmarks
BenchmarkQwen TurboYi-1.5-34B
LMArena Non-English—1121
LMArena Chinese—1213
LMArena French—1156
LMArena German—1111
LMArena Japanese—1021
LMArena Korean—1005
LMArena Russian—1091
LMArena Spanish—1121

Instruction Following Not comparable

Qwen Turbo: —, Yi-1.5-34B: 59.2 (#257)

Instruction Following benchmarks
BenchmarkQwen TurboYi-1.5-34B
LMArena Instruction Following—1139

Long Context Not comparable

Qwen Turbo: —, Yi-1.5-34B: 34.6 (#248)

Long Context benchmarks
BenchmarkQwen TurboYi-1.5-34B
LMArena Longer Query—1143

Writing & Preference Not comparable

Qwen Turbo: —, Yi-1.5-34B: 37.4 (#257)

Writing & Preference benchmarks
BenchmarkQwen TurboYi-1.5-34B
LMArena Text—1173
LMArena Creative Writing—1135
LMArena Multi-Turn—1153

Frequently asked questions

Is Qwen Turbo better than Yi-1.5-34B?

Yi-1.5-34B is the stronger model overall, scoring 30.6 to 27.1 on the Noometry Index.

How many benchmarks do Qwen Turbo and Yi-1.5-34B share?

2 benchmarks have published results for both models. Qwen Turbo has 3 scored results on Noometry and Yi-1.5-34B has 21.

Related comparisons

Go deeper