Model comparison

Qwen1.5-110B vs Qwen2.5 Plus 1127

Qwen2.5 Plus 1127 is the stronger model overall, scoring 38.8 to 34.2 on the Noometry Index.

Last verified . 14 shared benchmarks.

Qwen1.5-110B Alibaba (Qwen)

34.2

Rank #234 Confirmed

Qwen2.5 Plus 1127 Alibaba (Qwen)

38.8

Rank #181 Confirmed

Summary

  • They share 14 benchmarks with published results for both. Qwen1.5-110B scores higher in 0 categories and Qwen2.5 Plus 1127 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen2.5 Plus 1127 leads 49.4 to 38.0.
  • Qwen1.5-110B has downloadable open weights; the other is API-only.

Side by side

Qwen1.5-110B and Qwen2.5 Plus 1127 specifications
Qwen1.5-110BQwen2.5 Plus 1127
ProviderAlibaba (Qwen)Alibaba (Qwen)
Noometry Index34.238.8
Released2024-04-25—
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2014

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen2.5 Plus 1127 leads

Qwen1.5-110B: 33.0 (#264), Qwen2.5 Plus 1127: 38.5 (#175)

Coding benchmarks
BenchmarkQwen1.5-110BQwen2.5 Plus 1127
LMArena Coding11841314
BigCodeBench Instruct35%—
BigCodeBench Complete44.4%—

Reasoning Qwen2.5 Plus 1127 leads

Qwen1.5-110B: 22.7 (#189), Qwen2.5 Plus 1127: 25.9 (#141)

Reasoning benchmarks
BenchmarkQwen1.5-110BQwen2.5 Plus 1127
LMArena Hard Prompts11681299
ForecastBench57.7—

Math Qwen2.5 Plus 1127 leads

Qwen1.5-110B: 33.7 (#201), Qwen2.5 Plus 1127: 36.1 (#174)

Math benchmarks
BenchmarkQwen1.5-110BQwen2.5 Plus 1127
LMArena Math11851298

Knowledge Qwen2.5 Plus 1127 leads

Qwen1.5-110B: 31.2 (#219), Qwen2.5 Plus 1127: 35.5 (#183)

Knowledge benchmarks
BenchmarkQwen1.5-110BQwen2.5 Plus 1127
LMArena Expert11441289

Multilingual Qwen2.5 Plus 1127 leads

Qwen1.5-110B: 33.6 (#250), Qwen2.5 Plus 1127: 41.9 (#201)

Multilingual benchmarks
BenchmarkQwen1.5-110BQwen2.5 Plus 1127
LMArena Non-English11421265
LMArena Chinese12061314
LMArena German11231231
LMArena Japanese10741207
LMArena Russian11181271
LMArena French1151—
LMArena Korean1044—
LMArena Spanish1142—

Instruction Following Qwen2.5 Plus 1127 leads

Qwen1.5-110B: 60.3 (#252), Qwen2.5 Plus 1127: 67.2 (#199)

Instruction Following benchmarks
BenchmarkQwen1.5-110BQwen2.5 Plus 1127
LMArena Instruction Following11581275

Long Context Qwen2.5 Plus 1127 leads

Qwen1.5-110B: 35.1 (#242), Qwen2.5 Plus 1127: 39.2 (#184)

Long Context benchmarks
BenchmarkQwen1.5-110BQwen2.5 Plus 1127
LMArena Longer Query11571292

Writing & Preference Qwen2.5 Plus 1127 leads

Qwen1.5-110B: 38.0 (#255), Qwen2.5 Plus 1127: 49.4 (#192)

Writing & Preference benchmarks
BenchmarkQwen1.5-110BQwen2.5 Plus 1127
LMArena Text11751299
LMArena Creative Writing11481262
LMArena Multi-Turn11601299

Frequently asked questions

Is Qwen1.5-110B better than Qwen2.5 Plus 1127?

Qwen2.5 Plus 1127 is the stronger model overall, scoring 38.8 to 34.2 on the Noometry Index.

Is Qwen1.5-110B or Qwen2.5 Plus 1127 better for coding?

Qwen2.5 Plus 1127 scores higher on coding benchmarks: 38.5 versus 33.0 in the Noometry coding category.

How many benchmarks do Qwen1.5-110B and Qwen2.5 Plus 1127 share?

14 benchmarks have published results for both models. Qwen1.5-110B has 20 scored results on Noometry and Qwen2.5 Plus 1127 has 14.

Related comparisons

Go deeper