Noometry

Model comparison

Claude 3.5 Haiku vs Qwen3.8 Max

Qwen3.8 Max is the stronger model overall, scoring 56.8 to 29.2 on the Noometry Index.

Last verified . 24 shared benchmarks.

Claude 3.5 Haiku Anthropic

29.2

Rank #315 Confirmed

Qwen3.8 Max Alibaba (Qwen)

56.8

Rank #22 Confirmed

Summary

  • They share 24 benchmarks with published results for both. Claude 3.5 Haiku scores higher in 0 categories and Qwen3.8 Max in 10 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in math, where Qwen3.8 Max leads 73.2 to 14.7.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.3% for Claude 3.5 Haiku and 100% for Qwen3.8 Max.

Side by side

Claude 3.5 HaikuQwen3.8 Max
ProviderAnthropicAlibaba (Qwen)
Noometry Index29.256.8
Released2024-10-222026-08-02
WeightsProprietaryProprietary
Context window—1M
Max output—131K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked4939

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.8 Max leads

Claude 3.5 Haiku: 32.9 (#265), Qwen3.8 Max: 53.5 (#29)

BenchmarkClaude 3.5 HaikuQwen3.8 Max
SciCode27.4%53.2%
LMArena Coding12861502
DeepSWE—57.5%
Aider Polyglot28%—
LMArena WebDev—1674
FrontierSWE—17.8%
WeirdML30.7%—
BigCodeBench Instruct46.1%—
LiveBench Coding51.4%—
BigCodeBench Complete59%—
CadEval32%—

Agentic & Tool Use Qwen3.8 Max leads

Claude 3.5 Haiku: 28.0 (#95), Qwen3.8 Max: 45.4 (#14)

BenchmarkClaude 3.5 HaikuQwen3.8 Max
APEX-Agents—63.3%
τ²-bench Banking—55.1%
BALROG19.3%—
GDP.pdf—23.2%

Reasoning Qwen3.8 Max leads

Claude 3.5 Haiku: 17.7 (#290), Qwen3.8 Max: 54.4 (#26)

BenchmarkClaude 3.5 HaikuQwen3.8 Max
CritPt0%20%
LMArena Hard Prompts12511496
DTBench56.7%92%
Epoch Capabilities Index127.15156.41
NYT Connections (extended)—88.3%
Chess Puzzles—40%
LiveBench Reasoning28.1%—
Mystery Game Puzzles—38%
LiveBench Data Analysis48.5%—
LMCA—46.2%
LiveBench43.5%—

Math Qwen3.8 Max leads

Claude 3.5 Haiku: 14.7 (#300), Qwen3.8 Max: 73.2 (#20)

BenchmarkClaude 3.5 HaikuQwen3.8 Max
OTIS Mock AIME 2024-20254.3%100%
LMArena Math12441499
FrontierMath (Tiers 1-3)—74.7%
FrontierMath Tier 4—46.3%
ProofBench—58%
Omni-MATH22.4%—
LiveBench Math35.5%—
MATH Level 546.4%—
FrontierMath (Feb 2025 set)0.3%—

Knowledge Qwen3.8 Max leads

Claude 3.5 Haiku: 18.7 (#281), Qwen3.8 Max: 61.7 (#27)

BenchmarkClaude 3.5 HaikuQwen3.8 Max
GPQA Diamond38.1%92.7%
LMArena Expert12081507
SimpleQA Verified—47.3%
MMLU-Pro60.5%—
Confabulations36.7%—
GPQA (HELM)36.3%—
MMLU74.3%—

Multimodal Qwen3.8 Max leads

Claude 3.5 Haiku: 26.8 (#117), Qwen3.8 Max: 37.2 (#75)

BenchmarkClaude 3.5 HaikuQwen3.8 Max
LMArena Vision10921314
GeoBench34%—
Furniture Assembly—20%

Multilingual Qwen3.8 Max leads

Claude 3.5 Haiku: 40.0 (#218), Qwen3.8 Max: 56.7 (#18)

BenchmarkClaude 3.5 HaikuQwen3.8 Max
LMArena Non-English12381472
LMArena Chinese12291538
LMArena French12641503
LMArena German12371483
LMArena Japanese11751467
LMArena Korean11731461
LMArena Russian12531481
LMArena Spanish12611492

Instruction Following Qwen3.8 Max leads

Claude 3.5 Haiku: 62.9 (#234), Qwen3.8 Max: 77.6 (#17)

BenchmarkClaude 3.5 HaikuQwen3.8 Max
LMArena Instruction Following12411479
LiveBench Instruction Following61.9%—
IFEval79.2%—

Long Context Qwen3.8 Max leads

Claude 3.5 Haiku: 38.3 (#200), Qwen3.8 Max: 45.6 (#31)

BenchmarkClaude 3.5 HaikuQwen3.8 Max
LMArena Longer Query12611489

Writing & Preference Qwen3.8 Max leads

Claude 3.5 Haiku: 42.7 (#234), Qwen3.8 Max: 67.1 (#30)

BenchmarkClaude 3.5 HaikuQwen3.8 Max
LMArena Text12551483
LMArena Creative Writing12331479
LMArena Multi-Turn12651489
Short-Story Creative Writing73.5%—
EQ-Bench Creative Writing1146—
WildBench76%—
LiveBench Language35.4%—

Frequently asked questions

Is Claude 3.5 Haiku better than Qwen3.8 Max?

Qwen3.8 Max is the stronger model overall, scoring 56.8 to 29.2 on the Noometry Index.

Is Claude 3.5 Haiku or Qwen3.8 Max better for coding?

Qwen3.8 Max scores higher on coding benchmarks: 53.5 versus 32.9 in the Noometry coding category.

How many benchmarks do Claude 3.5 Haiku and Qwen3.8 Max share?

24 benchmarks have published results for both models. Claude 3.5 Haiku has 49 scored results on Noometry and Qwen3.8 Max has 39.

Related comparisons

Go deeper