Noometry

Model comparison

Claude 3 Haiku vs Granite 4.0 Micro

Granite 4.0 Micro is the stronger model overall, scoring 28.8 to 25.7 on the Noometry Index.

Last verified . 2 shared benchmarks.

Claude 3 Haiku Anthropic

25.7

Rank #333 Confirmed

Granite 4.0 Micro IBM

28.8

Rank #312 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Claude 3 Haiku scores higher in 1 category and Granite 4.0 Micro in 4 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Granite 4.0 Micro leads 46.7 to 29.8.
  • The biggest single-benchmark swing is GPQA Diamond: 36.3% for Claude 3 Haiku and 28.3% for Granite 4.0 Micro.
  • Granite 4.0 Micro has downloadable open weights; the other is API-only.

Side by side

Claude 3 HaikuGranite 4.0 Micro
ProviderAnthropicIBM
Noometry Index25.728.8
Released2024-03-072025-10-02
WeightsProprietaryOpen
Context window—131K
Max output—118K
Input $ / M tokens—$0.017
Output $ / M tokens—$0.11
Results tracked378

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude 3 Haiku: 26.1 (#320), Granite 4.0 Micro: —

BenchmarkClaude 3 HaikuGranite 4.0 Micro
WeirdML9.8%—
BigCodeBench Instruct39.4%—
LMArena Coding1199—
BigCodeBench Complete50.1%—
CadEval12%—
HumanEval+68.9%—
MBPP+68.8%—

Reasoning Granite 4.0 Micro leads

Claude 3 Haiku: 15.7 (#303), Granite 4.0 Micro: 18.5 (#261)

BenchmarkClaude 3 HaikuGranite 4.0 Micro
Kagi LLM Benchmark34.2%—
Chess Puzzles—0%
LMArena Hard Prompts1174—
DTBench50.1%—
LMCA8.8%—
Epoch Capabilities Index118.3—
ForecastBench53.2—
WinoGrande74.2%—

Math Granite 4.0 Micro leads

Claude 3 Haiku: 9.2 (#313), Granite 4.0 Micro: 11.2 (#301)

BenchmarkClaude 3 HaikuGranite 4.0 Micro
OTIS Mock AIME 2024-20251.8%2.8%
Omni-MATH—20.9%
LMArena Math1188—
MATH Level 514.9%—

Knowledge Claude 3 Haiku leads

Claude 3 Haiku: 17.3 (#280), Granite 4.0 Micro: 9.9 (#299)

BenchmarkClaude 3 HaikuGranite 4.0 Micro
GPQA Diamond36.3%28.3%
MMLU-Pro—39.5%
Confabulations34.2%—
GPQA (HELM)—30.7%
LMArena Expert1148—
MMLU73.8%—

Multimodal Not comparable

Claude 3 Haiku: 23.1 (#123), Granite 4.0 Micro: —

BenchmarkClaude 3 HaikuGranite 4.0 Micro
LMArena Vision950—
ScienceQA72%—

Multilingual Not comparable

Claude 3 Haiku: 36.1 (#238), Granite 4.0 Micro: —

BenchmarkClaude 3 HaikuGranite 4.0 Micro
LMArena Non-English1178—
LMArena Chinese1155—
LMArena French1194—
LMArena German1174—
LMArena Japanese1102—
LMArena Korean1108—
LMArena Russian1204—
LMArena Spanish1165—

Instruction Following Granite 4.0 Micro leads

Claude 3 Haiku: 61.5 (#242), Granite 4.0 Micro: 70.0 (#164)

BenchmarkClaude 3 HaikuGranite 4.0 Micro
IFEval—84.9%
LMArena Instruction Following1174—

Long Context Not comparable

Claude 3 Haiku: 36.1 (#232), Granite 4.0 Micro: —

BenchmarkClaude 3 HaikuGranite 4.0 Micro
LMArena Longer Query1191—

Writing & Preference Granite 4.0 Micro leads

Claude 3 Haiku: 29.8 (#286), Granite 4.0 Micro: 46.7 (#212)

BenchmarkClaude 3 HaikuGranite 4.0 Micro
LMArena Text1195—
LMArena Creative Writing1157—
EQ-Bench Creative Writing717—
WildBench—67%
LMArena Multi-Turn1190—

Frequently asked questions

Is Claude 3 Haiku better than Granite 4.0 Micro?

Granite 4.0 Micro is the stronger model overall, scoring 28.8 to 25.7 on the Noometry Index.

How many benchmarks do Claude 3 Haiku and Granite 4.0 Micro share?

2 benchmarks have published results for both models. Claude 3 Haiku has 37 scored results on Noometry and Granite 4.0 Micro has 8.

Related comparisons

Go deeper