Model comparison

Qwen Turbo vs Yi-34B

Qwen Turbo and Yi-34B score almost the same on the Noometry Index (27.1 vs 27.8), so choose on price, context window or the category you care about most.

Last verified . 2 shared benchmarks.

Qwen Turbo Alibaba (Qwen)

27.1

Rank #335 Reported

Yi-34B 01.AI

27.8

Rank #329 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Qwen Turbo scores higher in 1 category and Yi-34B in 1 category; 2 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen Turbo leads 22.2 to 7.5.
  • The biggest single-benchmark swing is MATH Level 5: 56.2% for Qwen Turbo and 5.1% for Yi-34B.
  • Yi-34B has downloadable open weights; the other is API-only.

Side by side

Qwen Turbo and Yi-34B specifications
Qwen TurboYi-34B
ProviderAlibaba (Qwen)01.AI
Noometry Index27.127.8
Released2024-11-012023-11-02
WeightsProprietaryOpen
Context window1M—
Max output16K—
Input $ / M tokens$0.05—
Output $ / M tokens$0.20—
Results tracked323

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Qwen Turbo: —, Yi-34B: 32.3 (#274)

Coding benchmarks
BenchmarkQwen TurboYi-34B
LMArena Coding—1112

Reasoning Not comparable

Qwen Turbo: —, Yi-34B: 21.2 (#226)

Reasoning benchmarks
BenchmarkQwen TurboYi-34B
LMArena Hard Prompts—1104
BIG-Bench Hard—71.7%
Epoch Capabilities Index—117.39

Math Yi-34B leads

Qwen Turbo: 15.3 (#297), Yi-34B: 21.6 (#282)

Math benchmarks
BenchmarkQwen TurboYi-34B
MATH Level 556.2%5.1%
OTIS Mock AIME 2024-20256.1%—
LMArena Math—1114
GSM8K—76%

Knowledge Qwen Turbo leads

Qwen Turbo: 22.2 (#272), Yi-34B: 7.5 (#309)

Knowledge benchmarks
BenchmarkQwen TurboYi-34B
GPQA Diamond41.8%14.7%
LMArena Expert—1061
MMLU—76.3%

Multilingual Not comparable

Qwen Turbo: —, Yi-34B: 29.7 (#264)

Multilingual benchmarks
BenchmarkQwen TurboYi-34B
LMArena Non-English—1079
LMArena Chinese—1176
LMArena French—1081
LMArena German—1042
LMArena Japanese—993
LMArena Korean—959
LMArena Russian—1050
LMArena Spanish—1070

Instruction Following Not comparable

Qwen Turbo: —, Yi-34B: 56.2 (#274)

Instruction Following benchmarks
BenchmarkQwen TurboYi-34B
LMArena Instruction Following—1091

Long Context Not comparable

Qwen Turbo: —, Yi-34B: 33.2 (#264)

Long Context benchmarks
BenchmarkQwen TurboYi-34B
LMArena Longer Query—1094

Writing & Preference Not comparable

Qwen Turbo: —, Yi-34B: 34.1 (#273)

Writing & Preference benchmarks
BenchmarkQwen TurboYi-34B
LMArena Text—1129
LMArena Creative Writing—1108
LMArena Multi-Turn—1113

Frequently asked questions

Is Qwen Turbo better than Yi-34B?

Qwen Turbo and Yi-34B score almost the same on the Noometry Index (27.1 vs 27.8), so choose on price, context window or the category you care about most.

How many benchmarks do Qwen Turbo and Yi-34B share?

2 benchmarks have published results for both models. Qwen Turbo has 3 scored results on Noometry and Yi-34B has 23.

Related comparisons

Go deeper