Model comparison

Qwen1.5 4b Chat vs Qwen2.5 Plus 1127

Qwen2.5 Plus 1127 is the stronger model overall, scoring 38.1 to 28.3 on the Noometry Index.

Last verified . 13 shared benchmarks.

Qwen1.5 4b Chat Alibaba (Qwen)

28.3

Rank #319 Confirmed

Qwen2.5 Plus 1127 Alibaba (Qwen)

38.1

Rank #179 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Qwen1.5 4b Chat scores higher in 0 categories and Qwen2.5 Plus 1127 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen2.5 Plus 1127 leads 49.5 to 23.9.
  • Qwen1.5 4b Chat has downloadable open weights; the other is API-only.

Side by side

Qwen1.5 4b Chat and Qwen2.5 Plus 1127 specifications
Qwen1.5 4b ChatQwen2.5 Plus 1127
ProviderAlibaba (Qwen)Alibaba (Qwen)
Noometry Index28.338.1
Released——
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1314

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen2.5 Plus 1127 leads

Qwen1.5 4b Chat: 28.6 (#305), Qwen2.5 Plus 1127: 37.9 (#171)

Coding benchmarks
BenchmarkQwen1.5 4b ChatQwen2.5 Plus 1127
LMArena Coding9991314

Reasoning Qwen2.5 Plus 1127 leads

Qwen1.5 4b Chat: 17.7 (#277), Qwen2.5 Plus 1127: 24.8 (#139)

Reasoning benchmarks
BenchmarkQwen1.5 4b ChatQwen2.5 Plus 1127
LMArena Hard Prompts9761299

Math Qwen2.5 Plus 1127 leads

Qwen1.5 4b Chat: 27.9 (#233), Qwen2.5 Plus 1127: 33.5 (#175)

Math benchmarks
BenchmarkQwen1.5 4b ChatQwen2.5 Plus 1127
LMArena Math10261298

Knowledge Qwen2.5 Plus 1127 leads

Qwen1.5 4b Chat: 26.2 (#252), Qwen2.5 Plus 1127: 34.9 (#179)

Knowledge benchmarks
BenchmarkQwen1.5 4b ChatQwen2.5 Plus 1127
LMArena Expert9801289

Multilingual Qwen2.5 Plus 1127 leads

Qwen1.5 4b Chat: 24.2 (#285), Qwen2.5 Plus 1127: 42.1 (#196)

Multilingual benchmarks
BenchmarkQwen1.5 4b ChatQwen2.5 Plus 1127
LMArena Non-English9791265
LMArena Chinese10241314
LMArena German9021231
LMArena Russian9521271
LMArena Japanese—1207

Instruction Following Qwen2.5 Plus 1127 leads

Qwen1.5 4b Chat: 49.3 (#295), Qwen2.5 Plus 1127: 67.4 (#194)

Instruction Following benchmarks
BenchmarkQwen1.5 4b ChatQwen2.5 Plus 1127
LMArena Instruction Following9791275

Long Context Qwen2.5 Plus 1127 leads

Qwen1.5 4b Chat: 30.1 (#285), Qwen2.5 Plus 1127: 39.2 (#180)

Long Context benchmarks
BenchmarkQwen1.5 4b ChatQwen2.5 Plus 1127
LMArena Longer Query9881292

Writing & Preference Qwen2.5 Plus 1127 leads

Qwen1.5 4b Chat: 23.9 (#304), Qwen2.5 Plus 1127: 49.5 (#186)

Writing & Preference benchmarks
BenchmarkQwen1.5 4b ChatQwen2.5 Plus 1127
LMArena Text9971299
LMArena Creative Writing9691262
LMArena Multi-Turn9771299

Frequently asked questions

Is Qwen1.5 4b Chat better than Qwen2.5 Plus 1127?

Qwen2.5 Plus 1127 is the stronger model overall, scoring 38.1 to 28.3 on the Noometry Index.

Is Qwen1.5 4b Chat or Qwen2.5 Plus 1127 better for coding?

Qwen2.5 Plus 1127 scores higher on coding benchmarks: 37.9 versus 28.6 in the Noometry coding category.

How many benchmarks do Qwen1.5 4b Chat and Qwen2.5 Plus 1127 share?

13 benchmarks have published results for both models. Qwen1.5 4b Chat has 13 scored results on Noometry and Qwen2.5 Plus 1127 has 14.

Related comparisons

Go deeper