Model comparison

Qwen Max vs Qwen2.5-Max

Qwen2.5-Max is the stronger model overall, scoring 40.7 to 34.7 on the Noometry Index.

Last verified . 17 shared benchmarks.

Qwen Max Alibaba (Qwen)

34.7

Rank #230 Confirmed

Qwen2.5-Max Alibaba (Qwen)

40.7

Rank #146 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Qwen Max scores higher in 0 categories and Qwen2.5-Max in 8 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where Qwen2.5-Max leads 36.9 to 22.3.

Side by side

Qwen Max and Qwen2.5-Max specifications
Qwen MaxQwen2.5-Max
ProviderAlibaba (Qwen)Alibaba (Qwen)
Noometry Index34.740.7
Released2024-04-032025-01-25
WeightsProprietaryProprietary
Context window33K—
Max output8K—
Input $ / M tokens$1.60—
Output $ / M tokens$6.40—
Results tracked2327

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen2.5-Max leads

Qwen Max: 30.7 (#292), Qwen2.5-Max: 41.8 (#117)

Coding benchmarks
BenchmarkQwen MaxQwen2.5-Max
LMArena Coding12881359
Aider Polyglot21.8%—
LiveBench Coding—64.4%

Reasoning Too close to call

Qwen Max: 25.1 (#151), Qwen2.5-Max: 25.6 (#147)

Reasoning benchmarks
BenchmarkQwen MaxQwen2.5-Max
LMArena Hard Prompts12691360
LiveBench Reasoning—51.4%
LiveBench Data Analysis—67.9%
Epoch Capabilities Index—132.53
LiveBench—62.3%

Math Qwen2.5-Max leads

Qwen Max: 22.3 (#276), Qwen2.5-Max: 36.9 (#162)

Math benchmarks
BenchmarkQwen MaxQwen2.5-Max
LMArena Math12751369
OTIS Mock AIME 2024-202516.1%—
LiveBench Math—58.4%
MATH Level 567.2%—
FrontierMath (Feb 2025 set)1%—

Knowledge Qwen2.5-Max leads

Qwen Max: 30.3 (#228), Qwen2.5-Max: 35.3 (#186)

Knowledge benchmarks
BenchmarkQwen MaxQwen2.5-Max
LMArena Expert12481337
GPQA Diamond56.1%—
Confabulations—21.8%

Multilingual Qwen2.5-Max leads

Qwen Max: 41.8 (#202), Qwen2.5-Max: 48.1 (#146)

Multilingual benchmarks
BenchmarkQwen MaxQwen2.5-Max
LMArena Non-English12631352
LMArena Chinese12541382
LMArena French13301396
LMArena German12541350
LMArena Japanese12051300
LMArena Korean11421304
LMArena Russian12741353
LMArena Spanish12901377

Instruction Following Qwen2.5-Max leads

Qwen Max: 66.5 (#208), Qwen2.5-Max: 71.3 (#152)

Instruction Following benchmarks
BenchmarkQwen MaxQwen2.5-Max
LMArena Instruction Following12621335
LiveBench Instruction Following—75.3%

Long Context Qwen2.5-Max leads

Qwen Max: 39.4 (#180), Qwen2.5-Max: 41.4 (#142)

Long Context benchmarks
BenchmarkQwen MaxQwen2.5-Max
LMArena Longer Query12881358
Fiction.LiveBench66.7%—

Writing & Preference Qwen2.5-Max leads

Qwen Max: 47.8 (#205), Qwen2.5-Max: 55.4 (#146)

Writing & Preference benchmarks
BenchmarkQwen MaxQwen2.5-Max
LMArena Text12821367
LMArena Creative Writing12481339
LMArena Multi-Turn12771364
Short-Story Creative Writing—72.9%
LiveBench Language—56.3%

Frequently asked questions

Is Qwen Max better than Qwen2.5-Max?

Qwen2.5-Max is the stronger model overall, scoring 40.7 to 34.7 on the Noometry Index.

Is Qwen Max or Qwen2.5-Max better for coding?

Qwen2.5-Max scores higher on coding benchmarks: 41.8 versus 30.7 in the Noometry coding category.

How many benchmarks do Qwen Max and Qwen2.5-Max share?

17 benchmarks have published results for both models. Qwen Max has 23 scored results on Noometry and Qwen2.5-Max has 27.

Related comparisons

Go deeper