Noometry

Model comparison

Claude 3 Haiku vs Qwen3 Max

Qwen3 Max is the stronger model overall, scoring 43.7 to 25.9 on the Noometry Index.

Last verified . 24 shared benchmarks.

Claude 3 Haiku Anthropic

25.9

Rank #340 Confirmed

Qwen3 Max Alibaba (Qwen)

43.7

Rank #87 Confirmed

Summary

  • They share 24 benchmarks with published results for both. Claude 3 Haiku scores higher in 0 categories and Qwen3 Max in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Qwen3 Max leads 62.4 to 29.7.
  • The biggest single-benchmark swing is MATH Level 5: 14.9% for Claude 3 Haiku and 97.1% for Qwen3 Max.

Side by side

Claude 3 HaikuQwen3 Max
ProviderAnthropicAlibaba (Qwen)
Noometry Index25.943.7
Released2024-03-072025-09-23
WeightsProprietaryProprietary
Context window—262K
Max output—66K
Input $ / M tokens—$1.20
Output $ / M tokens—$6
Results tracked3733

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3 Max leads

Claude 3 Haiku: 26.4 (#325), Qwen3 Max: 43.0 (#93)

BenchmarkClaude 3 HaikuQwen3 Max
LMArena Coding11991456
WeirdML9.8%—
BigCodeBench Instruct39.4%—
BigCodeBench Complete50.1%—
CadEval12%—
ALE-Bench—370.45
HumanEval+68.9%—
MBPP+68.8%—

Agentic & Tool Use Not comparable

Claude 3 Haiku: —, Qwen3 Max: —

BenchmarkClaude 3 HaikuQwen3 Max
Vending-Bench 2—71.56

Reasoning Qwen3 Max leads

Claude 3 Haiku: 16.3 (#307), Qwen3 Max: 22.6 (#190)

BenchmarkClaude 3 HaikuQwen3 Max
Kagi LLM Benchmark34.2%72.5%
LMArena Hard Prompts11741448
DTBench50.1%82.1%
LMCA8.8%28.3%
Epoch Capabilities Index118.35142.38
NYT Connections (extended)—30.1%
Chess Puzzles—4%
Mystery Game Puzzles—5%
ForecastBench53.2—
WinoGrande74.2%—

Math Qwen3 Max leads

Claude 3 Haiku: 9.8 (#319), Qwen3 Max: 38.7 (#131)

BenchmarkClaude 3 HaikuQwen3 Max
OTIS Mock AIME 2024-20251.8%73.3%
LMArena Math11881446
MATH Level 514.9%97.1%
FrontierMath (Tiers 1-3)—18.9%

Knowledge Qwen3 Max leads

Claude 3 Haiku: 17.3 (#285), Qwen3 Max: 48.1 (#78)

BenchmarkClaude 3 HaikuQwen3 Max
GPQA Diamond36.3%72.6%
LMArena Expert11481455
SimpleQA Verified—48.7%
Confabulations34.2%—
MMLU73.8%—

Multimodal Not comparable

Claude 3 Haiku: 23.6 (#128), Qwen3 Max: —

BenchmarkClaude 3 HaikuQwen3 Max
LMArena Vision950—
ScienceQA72%—

Multilingual Qwen3 Max leads

Claude 3 Haiku: 36.0 (#243), Qwen3 Max: 53.7 (#62)

BenchmarkClaude 3 HaikuQwen3 Max
LMArena Non-English11781429
LMArena Chinese11551478
LMArena French11951449
LMArena German11741463
LMArena Japanese11021397
LMArena Korean11091399
LMArena Russian12041428
LMArena Spanish11661462

Instruction Following Qwen3 Max leads

Claude 3 Haiku: 61.3 (#247), Qwen3 Max: 74.8 (#87)

BenchmarkClaude 3 HaikuQwen3 Max
LMArena Instruction Following11731419

Long Context Qwen3 Max leads

Claude 3 Haiku: 36.1 (#237), Qwen3 Max: 41.6 (#134)

BenchmarkClaude 3 HaikuQwen3 Max
LMArena Longer Query11901438
Fiction.LiveBench—66.7%
CL-bench—14.5%

Writing & Preference Qwen3 Max leads

Claude 3 Haiku: 29.7 (#291), Qwen3 Max: 62.4 (#76)

BenchmarkClaude 3 HaikuQwen3 Max
LMArena Text11951439
LMArena Creative Writing11571402
LMArena Multi-Turn11901446
EQ-Bench Creative Writing717—

Frequently asked questions

Is Claude 3 Haiku better than Qwen3 Max?

Qwen3 Max is the stronger model overall, scoring 43.7 to 25.9 on the Noometry Index.

Is Claude 3 Haiku or Qwen3 Max better for coding?

Qwen3 Max scores higher on coding benchmarks: 43.0 versus 26.4 in the Noometry coding category.

How many benchmarks do Claude 3 Haiku and Qwen3 Max share?

24 benchmarks have published results for both models. Claude 3 Haiku has 37 scored results on Noometry and Qwen3 Max has 33.

Related comparisons

Go deeper