Noometry

Model comparison

Claude 3.5 Haiku vs Qwen3.7 Plus

Qwen3.7 Plus is the stronger model overall, scoring 45.3 to 29.2 on the Noometry Index.

Last verified . 24 shared benchmarks.

Claude 3.5 Haiku Anthropic

29.2

Rank #315 Confirmed

Qwen3.7 Plus Alibaba (Qwen)

45.3

Rank #72 Confirmed

Summary

  • They share 24 benchmarks with published results for both. Claude 3.5 Haiku scores higher in 1 category and Qwen3.7 Plus in 9 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3.7 Plus leads 54.9 to 18.7.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.3% for Claude 3.5 Haiku and 93.3% for Qwen3.7 Plus.

Side by side

Claude 3.5 HaikuQwen3.7 Plus
ProviderAnthropicAlibaba (Qwen)
Noometry Index29.245.3
Released2024-10-222026-06-02
WeightsProprietaryProprietary
Context window—1M
Max output—131K
Input $ / M tokens—$0.40
Output $ / M tokens—$1.60
Results tracked4932

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.7 Plus leads

Claude 3.5 Haiku: 32.9 (#265), Qwen3.7 Plus: 36.6 (#206)

BenchmarkClaude 3.5 HaikuQwen3.7 Plus
SciCode27.4%45.5%
LMArena Coding12861473
FrontierCode—10.2%
Aider Polyglot28%—
WeirdML30.7%—
BigCodeBench Instruct46.1%—
LiveBench Coding51.4%—
BigCodeBench Complete59%—
CadEval32%—

Agentic & Tool Use Claude 3.5 Haiku leads

Claude 3.5 Haiku: 28.0 (#95), Qwen3.7 Plus: 21.4 (#138)

BenchmarkClaude 3.5 HaikuQwen3.7 Plus
OSWorld 2.0—2.8%
BALROG19.3%—

Reasoning Qwen3.7 Plus leads

Claude 3.5 Haiku: 17.7 (#290), Qwen3.7 Plus: 39.3 (#59)

BenchmarkClaude 3.5 HaikuQwen3.7 Plus
CritPt0%9.1%
LMArena Hard Prompts12511460
DTBench56.7%84%
Epoch Capabilities Index127.15147.37
NYT Connections (extended)—74.8%
Chess Puzzles—24%
LiveBench Reasoning28.1%—
Mystery Game Puzzles—17%
LiveBench Data Analysis48.5%—
LMCA—37.6%
LiveBench43.5%—

Math Qwen3.7 Plus leads

Claude 3.5 Haiku: 14.7 (#300), Qwen3.7 Plus: 50.5 (#56)

BenchmarkClaude 3.5 HaikuQwen3.7 Plus
OTIS Mock AIME 2024-20254.3%93.3%
LMArena Math12441466
FrontierMath (Tiers 1-3)—34.4%
Omni-MATH22.4%—
LiveBench Math35.5%—
MATH Level 546.4%—
FrontierMath (Feb 2025 set)0.3%—

Knowledge Qwen3.7 Plus leads

Claude 3.5 Haiku: 18.7 (#281), Qwen3.7 Plus: 54.9 (#51)

BenchmarkClaude 3.5 HaikuQwen3.7 Plus
GPQA Diamond38.1%87.9%
LMArena Expert12081467
MMLU-Pro60.5%—
Confabulations36.7%—
GPQA (HELM)36.3%—
MMLU74.3%—

Multimodal Qwen3.7 Plus leads

Claude 3.5 Haiku: 26.8 (#117), Qwen3.7 Plus: 41.8 (#33)

BenchmarkClaude 3.5 HaikuQwen3.7 Plus
LMArena Vision10921279
GeoBench34%—
LMArena Document—1444

Multilingual Qwen3.7 Plus leads

Claude 3.5 Haiku: 40.0 (#218), Qwen3.7 Plus: 54.8 (#38)

BenchmarkClaude 3.5 HaikuQwen3.7 Plus
LMArena Non-English12381445
LMArena Chinese12291510
LMArena French12641473
LMArena German12371471
LMArena Japanese11751413
LMArena Korean11731415
LMArena Russian12531457
LMArena Spanish12611457

Instruction Following Qwen3.7 Plus leads

Claude 3.5 Haiku: 62.9 (#234), Qwen3.7 Plus: 75.8 (#52)

BenchmarkClaude 3.5 HaikuQwen3.7 Plus
LMArena Instruction Following12411440
LiveBench Instruction Following61.9%—
IFEval79.2%—

Long Context Qwen3.7 Plus leads

Claude 3.5 Haiku: 38.3 (#200), Qwen3.7 Plus: 44.5 (#65)

BenchmarkClaude 3.5 HaikuQwen3.7 Plus
LMArena Longer Query12611455

Writing & Preference Qwen3.7 Plus leads

Claude 3.5 Haiku: 42.7 (#234), Qwen3.7 Plus: 64.3 (#56)

BenchmarkClaude 3.5 HaikuQwen3.7 Plus
LMArena Text12551455
LMArena Creative Writing12331439
LMArena Multi-Turn12651460
Short-Story Creative Writing73.5%—
EQ-Bench Creative Writing1146—
WildBench76%—
LiveBench Language35.4%—

Frequently asked questions

Is Claude 3.5 Haiku better than Qwen3.7 Plus?

Qwen3.7 Plus is the stronger model overall, scoring 45.3 to 29.2 on the Noometry Index.

Is Claude 3.5 Haiku or Qwen3.7 Plus better for coding?

Qwen3.7 Plus scores higher on coding benchmarks: 36.6 versus 32.9 in the Noometry coding category.

How many benchmarks do Claude 3.5 Haiku and Qwen3.7 Plus share?

24 benchmarks have published results for both models. Claude 3.5 Haiku has 49 scored results on Noometry and Qwen3.7 Plus has 32.

Related comparisons

Go deeper