Model comparison

Claude Haiku 4.5 vs Granite 4.0 H Small

Claude Haiku 4.5 is the stronger model overall, scoring 39.5 to 36.5 on the Noometry Index.

Last verified . 19 shared benchmarks.

Claude Haiku 4.5 Anthropic

39.5

Rank #165 Confirmed

Granite 4.0 H Small IBM

36.5

Rank #214 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Claude Haiku 4.5 scores higher in 7 categories and Granite 4.0 H Small in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Claude Haiku 4.5 leads 57.9 to 43.8.
  • The biggest single-benchmark swing is Omni-MATH: 56.1% for Claude Haiku 4.5 and 29.6% for Granite 4.0 H Small.
  • Granite 4.0 H Small has downloadable open weights; the other is API-only.

Side by side

Claude Haiku 4.5 and Granite 4.0 H Small specifications
Claude Haiku 4.5Granite 4.0 H Small
ProviderAnthropicIBM
Noometry Index39.536.5
Released2025-10-15—
WeightsProprietaryOpen
Context window200K—
Max output64K—
Input $ / M tokens$1—
Output $ / M tokens$5—
Results tracked5319

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Haiku 4.5 leads

Claude Haiku 4.5: 44.0 (#78), Granite 4.0 H Small: 36.4 (#209)

Coding benchmarks
BenchmarkClaude Haiku 4.5Granite 4.0 H Small
LMArena Coding14531249
SWE-bench Verified (bash only)66.6%—
LMArena WebDev1330—
SWE-bench Multilingual64.7%—
SciCode43.3%—
WeirdML45.4%—
ALE-Bench653.48—

Agentic & Tool Use Not comparable

Claude Haiku 4.5: 33.6 (#52), Granite 4.0 H Small: —

Agentic & Tool Use benchmarks
BenchmarkClaude Haiku 4.5Granite 4.0 H Small
Terminal-Bench35.5%—
Berkeley Function Calling Leaderboard68.7%—
DeepResearch Bench45.5%—
BALROG31.2%—
ExploitBench13.7%—
Vending-Bench 2458.89—

Reasoning Granite 4.0 H Small leads

Claude Haiku 4.5: 15.1 (#320), Granite 4.0 H Small: 24.4 (#163)

Reasoning benchmarks
BenchmarkClaude Haiku 4.5Granite 4.0 H Small
LMArena Hard Prompts14201240
ARC-AGI-24%—
NYT Connections (extended)14.3%—
ARC-AGI-147.7%—
CritPt0%—
Chess Puzzles8%—
DTBench73.6%—
LMCA30.9%—
Epoch Capabilities Index142.41—
ForecastBench61.4—

Math Claude Haiku 4.5 leads

Claude Haiku 4.5: 44.9 (#78), Granite 4.0 H Small: 31.4 (#223)

Math benchmarks
BenchmarkClaude Haiku 4.5Granite 4.0 H Small
Omni-MATH56.1%29.6%
LMArena Math13961247
OTIS Mock AIME 2024-202566.7%—
MATH Level 596.4%—
FrontierMath (Feb 2025 set)5.9%—
FrontierMath Tier 4 (v1)2.1%—

Knowledge Claude Haiku 4.5 leads

Claude Haiku 4.5: 37.7 (#153), Granite 4.0 H Small: 32.0 (#215)

Knowledge benchmarks
BenchmarkClaude Haiku 4.5Granite 4.0 H Small
MMLU-Pro77.7%56.9%
Vectara Hallucination Rate9.8%5.2%
GPQA (HELM)60.5%38.3%
LMArena Expert14421251
GPQA Diamond71.2%—
SimpleQA Verified13.2%—

Multimodal Not comparable

Claude Haiku 4.5: 26.8 (#118), Granite 4.0 H Small: —

Multimodal benchmarks
BenchmarkClaude Haiku 4.5Granite 4.0 H Small
Blueprint-Bench 20%—
LMArena Document1420—

Multilingual Claude Haiku 4.5 leads

Claude Haiku 4.5: 49.9 (#129), Granite 4.0 H Small: 38.6 (#228)

Multilingual benchmarks
BenchmarkClaude Haiku 4.5Granite 4.0 H Small
LMArena Non-English13771216
LMArena Chinese14171249
LMArena Russian13811201
LMArena Spanish14201258
LMArena French1408—
LMArena German1375—
LMArena Japanese1339—
LMArena Korean1347—

Instruction Following Claude Haiku 4.5 leads

Claude Haiku 4.5: 71.4 (#149), Granite 4.0 H Small: 68.7 (#183)

Instruction Following benchmarks
BenchmarkClaude Haiku 4.5Granite 4.0 H Small
IFEval80.1%89%
LMArena Instruction Following14141222

Long Context Claude Haiku 4.5 leads

Claude Haiku 4.5: 43.6 (#92), Granite 4.0 H Small: 37.7 (#213)

Long Context benchmarks
BenchmarkClaude Haiku 4.5Granite 4.0 H Small
LMArena Longer Query14271242

Writing & Preference Claude Haiku 4.5 leads

Claude Haiku 4.5: 57.9 (#123), Granite 4.0 H Small: 43.8 (#227)

Writing & Preference benchmarks
BenchmarkClaude Haiku 4.5Granite 4.0 H Small
LMArena Text13961241
LMArena Creative Writing13721211
WildBench83.9%73.9%
LMArena Multi-Turn14091242
EQ-Bench 41064—

Frequently asked questions

Is Claude Haiku 4.5 better than Granite 4.0 H Small?

Claude Haiku 4.5 is the stronger model overall, scoring 39.5 to 36.5 on the Noometry Index.

Is Claude Haiku 4.5 or Granite 4.0 H Small better for coding?

Claude Haiku 4.5 scores higher on coding benchmarks: 44.0 versus 36.4 in the Noometry coding category.

How many benchmarks do Claude Haiku 4.5 and Granite 4.0 H Small share?

19 benchmarks have published results for both models. Claude Haiku 4.5 has 53 scored results on Noometry and Granite 4.0 H Small has 19.

Related comparisons

Go deeper