Noometry

Model comparison

Claude Haiku 4.5 vs Qwen3.6 27B

Qwen3.6 27B is the stronger model overall, scoring 42.2 to 39.5 on the Noometry Index.

Last verified . 9 shared benchmarks.

Claude Haiku 4.5 Anthropic

39.5

Rank #165 Confirmed

Qwen3.6 27B Alibaba (Qwen)

42.2

Rank #117 Confirmed

Summary

  • They share 9 benchmarks with published results for both. Claude Haiku 4.5 scores higher in 2 categories and Qwen3.6 27B in 3 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Qwen3.6 27B leads 52.4 to 37.7.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 66.7% for Claude Haiku 4.5 and 91.1% for Qwen3.6 27B.
  • Qwen3.6 27B is cheaper at $0.60 / $3.60 per million input/output tokens, against $1 / $5 for Claude Haiku 4.5.
  • Qwen3.6 27B accepts more context: 262K tokens versus 200K.
  • Qwen3.6 27B has downloadable open weights; the other is API-only.

Side by side

Claude Haiku 4.5Qwen3.6 27B
ProviderAnthropicAlibaba (Qwen)
Noometry Index39.542.2
Released2025-10-152026-04-22
WeightsProprietaryOpen
Context window200K262K
Max output64K66K
Input $ / M tokens$1$0.60
Output $ / M tokens$5$3.60
Results tracked5311

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Haiku 4.5 leads

Claude Haiku 4.5: 44.0 (#78), Qwen3.6 27B: 39.1 (#163)

BenchmarkClaude Haiku 4.5Qwen3.6 27B
SciCode43.3%37.3%
SWE-bench Verified (bash only)66.6%—
LMArena WebDev1330—
SWE-bench Multilingual64.7%—
WeirdML45.4%—
LMArena Coding1453—
ALE-Bench653.48—

Agentic & Tool Use Not comparable

Claude Haiku 4.5: 33.6 (#52), Qwen3.6 27B: —

BenchmarkClaude Haiku 4.5Qwen3.6 27B
Terminal-Bench35.5%—
Berkeley Function Calling Leaderboard68.7%—
DeepResearch Bench45.5%—
BALROG31.2%—
ExploitBench13.7%—
Vending-Bench 2458.89—

Reasoning Qwen3.6 27B leads

Claude Haiku 4.5: 15.1 (#320), Qwen3.6 27B: 25.0 (#153)

BenchmarkClaude Haiku 4.5Qwen3.6 27B
CritPt0%0.9%
Chess Puzzles8%22%
DTBench73.6%78.1%
LMCA30.9%34.5%
Epoch Capabilities Index142.41146.5
ARC-AGI-24%—
NYT Connections (extended)14.3%—
ARC-AGI-147.7%—
LMArena Hard Prompts1420—
Mystery Game Puzzles—7%
ForecastBench61.4—

Math Qwen3.6 27B leads

Claude Haiku 4.5: 44.9 (#78), Qwen3.6 27B: 48.5 (#62)

BenchmarkClaude Haiku 4.5Qwen3.6 27B
OTIS Mock AIME 2024-202566.7%91.1%
FrontierMath (Tiers 1-3)—35.1%
Omni-MATH56.1%—
LMArena Math1396—
MATH Level 596.4%—
FrontierMath (Feb 2025 set)5.9%—
FrontierMath Tier 4 (v1)2.1%—

Knowledge Qwen3.6 27B leads

Claude Haiku 4.5: 37.7 (#153), Qwen3.6 27B: 52.4 (#63)

BenchmarkClaude Haiku 4.5Qwen3.6 27B
GPQA Diamond71.2%85.9%
SimpleQA Verified13.2%—
MMLU-Pro77.7%—
Vectara Hallucination Rate9.8%—
GPQA (HELM)60.5%—
LMArena Expert1442—

Multimodal Not comparable

Claude Haiku 4.5: 26.8 (#118), Qwen3.6 27B: —

BenchmarkClaude Haiku 4.5Qwen3.6 27B
Blueprint-Bench 20%—
LMArena Document1420—

Multilingual Not comparable

Claude Haiku 4.5: 49.9 (#129), Qwen3.6 27B: —

BenchmarkClaude Haiku 4.5Qwen3.6 27B
LMArena Non-English1377—
LMArena Chinese1417—
LMArena French1408—
LMArena German1375—
LMArena Japanese1339—
LMArena Korean1347—
LMArena Russian1381—
LMArena Spanish1420—

Instruction Following Not comparable

Claude Haiku 4.5: 71.4 (#149), Qwen3.6 27B: —

BenchmarkClaude Haiku 4.5Qwen3.6 27B
IFEval80.1%—
LMArena Instruction Following1414—

Long Context Not comparable

Claude Haiku 4.5: 43.6 (#92), Qwen3.6 27B: —

BenchmarkClaude Haiku 4.5Qwen3.6 27B
LMArena Longer Query1427—

Writing & Preference Claude Haiku 4.5 leads

Claude Haiku 4.5: 57.9 (#123), Qwen3.6 27B: 50.3 (#181)

BenchmarkClaude Haiku 4.5Qwen3.6 27B
EQ-Bench 410641026
LMArena Text1396—
LMArena Creative Writing1372—
WildBench83.9%—
LMArena Multi-Turn1409—

Frequently asked questions

Is Claude Haiku 4.5 better than Qwen3.6 27B?

Qwen3.6 27B is the stronger model overall, scoring 42.2 to 39.5 on the Noometry Index.

Which is cheaper, Claude Haiku 4.5 or Qwen3.6 27B?

Qwen3.6 27B is cheaper. It lists at $0.60 per million input tokens and $3.60 per million output tokens; Claude Haiku 4.5 lists at $1 and $5.

Is Claude Haiku 4.5 or Qwen3.6 27B better for coding?

Claude Haiku 4.5 scores higher on coding benchmarks: 44.0 versus 39.1 in the Noometry coding category.

Which has the bigger context window?

Qwen3.6 27B does, with 262K tokens against 200K.

How many benchmarks do Claude Haiku 4.5 and Qwen3.6 27B share?

9 benchmarks have published results for both models. Claude Haiku 4.5 has 53 scored results on Noometry and Qwen3.6 27B has 11.

Related comparisons

Go deeper