Noometry

Model comparison

Claude Sonnet 4 vs Qwen Max

Claude Sonnet 4 is the stronger model overall, scoring 40.8 to 34.7 on the Noometry Index. Qwen Max costs 2.1× less per token, which makes it the better buy when Claude Sonnet 4's lead doesn't matter for your workload.

Last verified . 23 shared benchmarks.

Claude Sonnet 4 Anthropic

40.8

Rank #145 Confirmed

Qwen Max Alibaba (Qwen)

34.7

Rank #230 Confirmed

Summary

  • They share 23 benchmarks with published results for both. Claude Sonnet 4 scores higher in 6 categories and Qwen Max in 2 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Sonnet 4 leads 43.3 to 22.3.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 71.1% for Claude Sonnet 4 and 16.1% for Qwen Max.
  • Qwen Max is cheaper at $1.60 / $6.40 per million input/output tokens, against $3 / $15 for Claude Sonnet 4.
  • Claude Sonnet 4 accepts more context: 200K tokens versus 33K.

Side by side

Claude Sonnet 4Qwen Max
ProviderAnthropicAlibaba (Qwen)
Noometry Index40.834.7
Released2025-05-222024-04-03
WeightsProprietaryProprietary
Context window200K33K
Max output64K8K
Input $ / M tokens$3$1.60
Output $ / M tokens$15$6.40
Results tracked5823

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 4 leads

Claude Sonnet 4: 43.5 (#88), Qwen Max: 30.7 (#292)

BenchmarkClaude Sonnet 4Qwen Max
Aider Polyglot61.3%21.8%
LMArena Coding14141288
SWE-bench Verified (bash only)64.9%—
SciCode40%—
GSO4.9%—
WeirdML46.1%—
ALE-Bench655.35—

Agentic & Tool Use Not comparable

Claude Sonnet 4: 38.5 (#31), Qwen Max: —

BenchmarkClaude Sonnet 4Qwen Max
TheAgentCompany33.1%—
Cybench35%—
DeepResearch Bench46.6%—
OSWorld43.9%—
METR Time Horizons62%—

Reasoning Qwen Max leads

Claude Sonnet 4: 22.9 (#187), Qwen Max: 25.1 (#151)

BenchmarkClaude Sonnet 4Qwen Max
LMArena Hard Prompts13721269
ARC-AGI-25.9%—
SimpleBench45.5%—
Kagi LLM Benchmark73%—
ARC-AGI-140%—
CritPt0.3%—
EnigmaEval3.1%—
DTBench77.1%—
LMCA29%—
Epoch Capabilities Index141.69—
ForecastBench60.2—

Math Claude Sonnet 4 leads

Claude Sonnet 4: 43.3 (#80), Qwen Max: 22.3 (#276)

BenchmarkClaude Sonnet 4Qwen Max
OTIS Mock AIME 2024-202571.1%16.1%
LMArena Math13751275
MATH Level 584.4%67.2%
FrontierMath (Feb 2025 set)4.1%1%
Omni-MATH60.2%—
FrontierMath Tier 4 (v1)0%—

Knowledge Claude Sonnet 4 leads

Claude Sonnet 4: 41.8 (#108), Qwen Max: 30.3 (#228)

BenchmarkClaude Sonnet 4Qwen Max
GPQA Diamond79.2%56.1%
LMArena Expert13721248
Humanity's Last Exam7.8%—
MMLU-Pro84.3%—
Confabulations13.2%—
Vectara Hallucination Rate10.3%—
GPQA (HELM)70.6%—

Multimodal Not comparable

Claude Sonnet 4: 26.2 (#121), Qwen Max: —

BenchmarkClaude Sonnet 4Qwen Max
LMArena Vision1191—
GeoBench37%—
VPCT34%—
MindCube44.8%—

Multilingual Claude Sonnet 4 leads

Claude Sonnet 4: 46.7 (#156), Qwen Max: 41.8 (#202)

BenchmarkClaude Sonnet 4Qwen Max
LMArena Non-English13331263
LMArena Chinese13501254
LMArena French13631330
LMArena German13311254
LMArena Japanese13021205
LMArena Korean12911142
LMArena Russian13551274
LMArena Spanish13571290

Instruction Following Claude Sonnet 4 leads

Claude Sonnet 4: 71.7 (#145), Qwen Max: 66.5 (#208)

BenchmarkClaude Sonnet 4Qwen Max
LMArena Instruction Following13761262
IFEval84%—

Long Context Qwen Max leads

Claude Sonnet 4: 33.7 (#259), Qwen Max: 39.4 (#180)

BenchmarkClaude Sonnet 4Qwen Max
Fiction.LiveBench46.9%66.7%
LMArena Longer Query13981288

Writing & Preference Claude Sonnet 4 leads

Claude Sonnet 4: 57.1 (#132), Qwen Max: 47.8 (#205)

BenchmarkClaude Sonnet 4Qwen Max
LMArena Text13511282
LMArena Creative Writing13451248
LMArena Multi-Turn13761277
Short-Story Creative Writing81.4%—
EQ-Bench Creative Writing1483—
WildBench83.8%—

Frequently asked questions

Is Claude Sonnet 4 better than Qwen Max?

Claude Sonnet 4 is the stronger model overall, scoring 40.8 to 34.7 on the Noometry Index. Qwen Max costs 2.1× less per token, which makes it the better buy when Claude Sonnet 4's lead doesn't matter for your workload.

Which is cheaper, Claude Sonnet 4 or Qwen Max?

Qwen Max is cheaper. It lists at $1.60 per million input tokens and $6.40 per million output tokens; Claude Sonnet 4 lists at $3 and $15.

Is Claude Sonnet 4 or Qwen Max better for coding?

Claude Sonnet 4 scores higher on coding benchmarks: 43.5 versus 30.7 in the Noometry coding category.

Which has the bigger context window?

Claude Sonnet 4 does, with 200K tokens against 33K.

How many benchmarks do Claude Sonnet 4 and Qwen Max share?

23 benchmarks have published results for both models. Claude Sonnet 4 has 58 scored results on Noometry and Qwen Max has 23.

Related comparisons

Go deeper