Model comparison

Claude 2.1 vs Qwen3 Max

Qwen3 Max is the stronger model overall, scoring 43.7 to 25.2 on the Noometry Index.

Last verified . 4 shared benchmarks.

Claude 2.1 Anthropic

25.2

Rank #345 Reported

Qwen3 Max Alibaba (Qwen)

43.7

Rank #87 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Claude 2.1 scores higher in 0 categories and Qwen3 Max in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3 Max leads 48.1 to 15.4.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.9% for Claude 2.1 and 73.3% for Qwen3 Max.

Side by side

Claude 2.1 and Qwen3 Max specifications
Claude 2.1Qwen3 Max
ProviderAnthropicAlibaba (Qwen)
Noometry Index25.243.7
Released2023-11-212025-09-23
WeightsProprietaryProprietary
Context window—262K
Max output—66K
Input $ / M tokens—$1.20
Output $ / M tokens—$6
Results tracked733

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3 Max leads

Claude 2.1: 26.2 (#327), Qwen3 Max: 43.0 (#93)

Coding benchmarks
BenchmarkClaude 2.1Qwen3 Max
WeirdML7.1%—
LMArena Coding—1456
ALE-Bench—370.45

Agentic & Tool Use Not comparable

Claude 2.1: —, Qwen3 Max: —

Agentic & Tool Use benchmarks
BenchmarkClaude 2.1Qwen3 Max
Vending-Bench 2—71.56

Reasoning Qwen3 Max leads

Claude 2.1: 21.4 (#221), Qwen3 Max: 22.6 (#190)

Reasoning benchmarks
BenchmarkClaude 2.1Qwen3 Max
DTBench51%82.1%
Epoch Capabilities Index119.27142.38
Kagi LLM Benchmark—72.5%
NYT Connections (extended)—30.1%
Chess Puzzles—4%
LMArena Hard Prompts—1448
Mystery Game Puzzles—5%
LMCA—28.3%
ForecastBench54.2—

Math Qwen3 Max leads

Claude 2.1: 10.2 (#315), Qwen3 Max: 38.7 (#131)

Math benchmarks
BenchmarkClaude 2.1Qwen3 Max
OTIS Mock AIME 2024-20251.9%73.3%
FrontierMath (Tiers 1-3)—18.9%
LMArena Math—1446
MATH Level 5—97.1%

Knowledge Qwen3 Max leads

Claude 2.1: 15.4 (#292), Qwen3 Max: 48.1 (#78)

Knowledge benchmarks
BenchmarkClaude 2.1Qwen3 Max
GPQA Diamond33%72.6%
SimpleQA Verified—48.7%
LMArena Expert—1455
MMLU73.5%—

Multilingual Not comparable

Claude 2.1: —, Qwen3 Max: 53.7 (#62)

Multilingual benchmarks
BenchmarkClaude 2.1Qwen3 Max
LMArena Non-English—1429
LMArena Chinese—1478
LMArena French—1449
LMArena German—1463
LMArena Japanese—1397
LMArena Korean—1399
LMArena Russian—1428
LMArena Spanish—1462

Instruction Following Not comparable

Claude 2.1: —, Qwen3 Max: 74.8 (#87)

Instruction Following benchmarks
BenchmarkClaude 2.1Qwen3 Max
LMArena Instruction Following—1419

Long Context Not comparable

Claude 2.1: —, Qwen3 Max: 41.6 (#134)

Long Context benchmarks
BenchmarkClaude 2.1Qwen3 Max
Fiction.LiveBench—66.7%
CL-bench—14.5%
LMArena Longer Query—1438

Writing & Preference Not comparable

Claude 2.1: —, Qwen3 Max: 62.4 (#76)

Writing & Preference benchmarks
BenchmarkClaude 2.1Qwen3 Max
LMArena Text—1439
LMArena Creative Writing—1402
LMArena Multi-Turn—1446

Frequently asked questions

Is Claude 2.1 better than Qwen3 Max?

Qwen3 Max is the stronger model overall, scoring 43.7 to 25.2 on the Noometry Index.

Is Claude 2.1 or Qwen3 Max better for coding?

Qwen3 Max scores higher on coding benchmarks: 43.0 versus 26.2 in the Noometry coding category.

How many benchmarks do Claude 2.1 and Qwen3 Max share?

4 benchmarks have published results for both models. Claude 2.1 has 7 scored results on Noometry and Qwen3 Max has 33.

Related comparisons

Go deeper