Model comparison

Qwen1.5-110B vs Yi-Large

Qwen1.5-110B has enough public results to be ranked (#231); Yi-Large does not yet, so treat this comparison as directional.

Last verified . 2 shared benchmarks.

Qwen1.5-110B Alibaba (Qwen)

33.6

Rank #231 Confirmed

Yi-Large 01.AI

37.6

Unranked Sparse

Summary

  • They share 2 benchmarks with published results for both. Qwen1.5-110B scores higher in 0 categories and Yi-Large in 1 category; one gap is clear of the uncertainty.
  • The widest gap is in coding, where Yi-Large leads 36.1 to 32.4.
  • Qwen1.5-110B has downloadable open weights; the other is API-only.

Side by side

Qwen1.5-110B and Yi-Large specifications
Qwen1.5-110BYi-Large
ProviderAlibaba (Qwen)01.AI
Noometry Index33.637.6
Released2024-04-252024-05-13
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked203

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Yi-Large leads

Qwen1.5-110B: 32.4 (#260), Yi-Large: 36.1 (#201)

Coding benchmarks
BenchmarkQwen1.5-110BYi-Large
BigCodeBench Instruct35%37.7%
BigCodeBench Complete44.4%47.2%
LMArena Coding1184—

Reasoning Not comparable

Qwen1.5-110B: 21.7 (#192), Yi-Large: —

Reasoning benchmarks
BenchmarkQwen1.5-110BYi-Large
LMArena Hard Prompts1168—
ForecastBench57.7—

Math Not comparable

Qwen1.5-110B: 31.1 (#199), Yi-Large: —

Math benchmarks
BenchmarkQwen1.5-110BYi-Large
LMArena Math1185—

Knowledge Not comparable

Qwen1.5-110B: 30.7 (#217), Yi-Large: —

Knowledge benchmarks
BenchmarkQwen1.5-110BYi-Large
LMArena Expert1144—
MMLU—79.3%

Multilingual Not comparable

Qwen1.5-110B: 33.8 (#245), Yi-Large: —

Multilingual benchmarks
BenchmarkQwen1.5-110BYi-Large
LMArena Non-English1142—
LMArena Chinese1206—
LMArena French1150—
LMArena German1123—
LMArena Japanese1074—
LMArena Korean1044—
LMArena Russian1118—
LMArena Spanish1141—

Instruction Following Not comparable

Qwen1.5-110B: 60.6 (#247), Yi-Large: —

Instruction Following benchmarks
BenchmarkQwen1.5-110BYi-Large
LMArena Instruction Following1158—

Long Context Not comparable

Qwen1.5-110B: 35.0 (#237), Yi-Large: —

Long Context benchmarks
BenchmarkQwen1.5-110BYi-Large
LMArena Longer Query1157—

Writing & Preference Not comparable

Qwen1.5-110B: 38.1 (#250), Yi-Large: —

Writing & Preference benchmarks
BenchmarkQwen1.5-110BYi-Large
LMArena Text1175—
LMArena Creative Writing1148—
LMArena Multi-Turn1160—

Frequently asked questions

Is Qwen1.5-110B better than Yi-Large?

Qwen1.5-110B has enough public results to be ranked (#231); Yi-Large does not yet, so treat this comparison as directional.

Is Qwen1.5-110B or Yi-Large better for coding?

Yi-Large scores higher on coding benchmarks: 36.1 versus 32.4 in the Noometry coding category.

How many benchmarks do Qwen1.5-110B and Yi-Large share?

2 benchmarks have published results for both models. Qwen1.5-110B has 20 scored results on Noometry and Yi-Large has 3.

Related comparisons

Go deeper