Model comparison

Qwen Plus vs Qwen1.5 4b Chat

Qwen Plus is the stronger model overall, scoring 36.7 to 28.3 on the Noometry Index.

Last verified . 12 shared benchmarks.

Qwen Plus Alibaba (Qwen)

36.7

Rank #204 Confirmed

Qwen1.5 4b Chat Alibaba (Qwen)

28.3

Rank #319 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Qwen Plus scores higher in 7 categories and Qwen1.5 4b Chat in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen Plus leads 52.4 to 23.9.
  • Qwen1.5 4b Chat has downloadable open weights; the other is API-only.

Side by side

Qwen Plus and Qwen1.5 4b Chat specifications
Qwen PlusQwen1.5 4b Chat
ProviderAlibaba (Qwen)Alibaba (Qwen)
Noometry Index36.728.3
Released2024-01-25—
WeightsProprietaryOpen
Context window1M—
Max output33K—
Input $ / M tokens$0.40—
Output $ / M tokens$1.20—
Results tracked2013

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen Plus leads

Qwen Plus: 38.3 (#163), Qwen1.5 4b Chat: 28.6 (#305)

Coding benchmarks
BenchmarkQwen PlusQwen1.5 4b Chat
LMArena Coding1328999

Reasoning Qwen Plus leads

Qwen Plus: 27.6 (#101), Qwen1.5 4b Chat: 17.7 (#277)

Reasoning benchmarks
BenchmarkQwen PlusQwen1.5 4b Chat
LMArena Hard Prompts1317976
Kagi LLM Benchmark63.3%—
DTBench81.1%—
LMCA24%—

Math Qwen1.5 4b Chat leads

Qwen Plus: 22.0 (#266), Qwen1.5 4b Chat: 27.9 (#233)

Math benchmarks
BenchmarkQwen PlusQwen1.5 4b Chat
LMArena Math13261026
OTIS Mock AIME 2024-202517.8%—
MATH Level 565.3%—
FrontierMath (Feb 2025 set)1.7%—

Knowledge Qwen Plus leads

Qwen Plus: 27.4 (#245), Qwen1.5 4b Chat: 26.2 (#252)

Knowledge benchmarks
BenchmarkQwen PlusQwen1.5 4b Chat
LMArena Expert1328980
GPQA Diamond48.1%—

Multilingual Qwen Plus leads

Qwen Plus: 45.3 (#170), Qwen1.5 4b Chat: 24.2 (#285)

Multilingual benchmarks
BenchmarkQwen PlusQwen1.5 4b Chat
LMArena Non-English1310979
LMArena Chinese13471024
LMArena Russian1323952
LMArena German—902
LMArena Japanese1251—

Instruction Following Qwen Plus leads

Qwen Plus: 69.0 (#176), Qwen1.5 4b Chat: 49.3 (#295)

Instruction Following benchmarks
BenchmarkQwen PlusQwen1.5 4b Chat
LMArena Instruction Following1303979

Long Context Qwen Plus leads

Qwen Plus: 40.3 (#153), Qwen1.5 4b Chat: 30.1 (#285)

Long Context benchmarks
BenchmarkQwen PlusQwen1.5 4b Chat
LMArena Longer Query1325988

Writing & Preference Qwen Plus leads

Qwen Plus: 52.4 (#171), Qwen1.5 4b Chat: 23.9 (#304)

Writing & Preference benchmarks
BenchmarkQwen PlusQwen1.5 4b Chat
LMArena Text1326997
LMArena Creative Writing1293969
LMArena Multi-Turn1336977

Frequently asked questions

Is Qwen Plus better than Qwen1.5 4b Chat?

Qwen Plus is the stronger model overall, scoring 36.7 to 28.3 on the Noometry Index.

Is Qwen Plus or Qwen1.5 4b Chat better for coding?

Qwen Plus scores higher on coding benchmarks: 38.3 versus 28.6 in the Noometry coding category.

How many benchmarks do Qwen Plus and Qwen1.5 4b Chat share?

12 benchmarks have published results for both models. Qwen Plus has 20 scored results on Noometry and Qwen1.5 4b Chat has 13.

Related comparisons

Go deeper