Model comparison

Qwen-14B vs Qwen Plus

Qwen Plus is the stronger model overall, scoring 37.1 to 31.4 on the Noometry Index.

Last verified . 10 shared benchmarks.

Qwen-14B Alibaba (Qwen)

31.4

Rank #275 Confirmed

Qwen Plus Alibaba (Qwen)

37.1

Rank #210 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Qwen-14B scores higher in 1 category and Qwen Plus in 6 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen Plus leads 52.2 to 27.6.
  • Qwen-14B has downloadable open weights; the other is API-only.

Side by side

Qwen-14B and Qwen Plus specifications
Qwen-14BQwen Plus
ProviderAlibaba (Qwen)Alibaba (Qwen)
Noometry Index31.437.1
Released2023-09-242024-01-25
WeightsOpenProprietary
Context window—1M
Max output—33K
Input $ / M tokens—$0.40
Output $ / M tokens—$1.20
Results tracked1820

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen Plus leads

Qwen-14B: 31.2 (#288), Qwen Plus: 38.9 (#167)

Coding benchmarks
BenchmarkQwen-14BQwen Plus
LMArena Coding10711328

Reasoning Qwen Plus leads

Qwen-14B: 19.6 (#257), Qwen Plus: 28.4 (#107)

Reasoning benchmarks
BenchmarkQwen-14BQwen Plus
LMArena Hard Prompts10271317
Kagi LLM Benchmark—63.3%
DTBench—81.1%
LMCA—24%
BIG-Bench Hard55%—
Epoch Capabilities Index113.03—
LAMBADA71.1%—
PIQA79.9%—

Math Qwen-14B leads

Qwen-14B: 31.2 (#227), Qwen Plus: 23.3 (#271)

Math benchmarks
BenchmarkQwen-14BQwen Plus
LMArena Math10681326
OTIS Mock AIME 2024-2025—17.8%
MATH Level 5—65.3%
FrontierMath (Feb 2025 set)—1.7%
GSM8K61.3%—

Knowledge Not comparable

Qwen-14B: —, Qwen Plus: 27.4 (#251)

Knowledge benchmarks
BenchmarkQwen-14BQwen Plus
GPQA Diamond—48.1%
LMArena Expert—1328
ARC (AI2) Challenge84.4%—
BoolQ86.2%—
MMLU66.3%—

Multilingual Qwen Plus leads

Qwen-14B: 27.5 (#275), Qwen Plus: 45.1 (#175)

Multilingual benchmarks
BenchmarkQwen-14BQwen Plus
LMArena Non-English10411310
LMArena Chinese10771347
LMArena Japanese—1251
LMArena Russian—1323

Instruction Following Qwen Plus leads

Qwen-14B: 52.4 (#289), Qwen Plus: 68.8 (#181)

Instruction Following benchmarks
BenchmarkQwen-14BQwen Plus
LMArena Instruction Following10311303

Long Context Qwen Plus leads

Qwen-14B: 31.3 (#280), Qwen Plus: 40.3 (#158)

Long Context benchmarks
BenchmarkQwen-14BQwen Plus
LMArena Longer Query10281324

Writing & Preference Qwen Plus leads

Qwen-14B: 27.6 (#299), Qwen Plus: 52.2 (#176)

Writing & Preference benchmarks
BenchmarkQwen-14BQwen Plus
LMArena Text10511326
LMArena Creative Writing10281293
LMArena Multi-Turn10221336

Frequently asked questions

Is Qwen-14B better than Qwen Plus?

Qwen Plus is the stronger model overall, scoring 37.1 to 31.4 on the Noometry Index.

Is Qwen-14B or Qwen Plus better for coding?

Qwen Plus scores higher on coding benchmarks: 38.9 versus 31.2 in the Noometry coding category.

How many benchmarks do Qwen-14B and Qwen Plus share?

10 benchmarks have published results for both models. Qwen-14B has 18 scored results on Noometry and Qwen Plus has 20.

Related comparisons

Go deeper