Model comparison

Granite 4.0 H Small vs Qwen2.5 32B Instruct

Granite 4.0 H Small is the stronger model overall, scoring 36.5 to 30.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Granite 4.0 H Small IBM

36.5

Rank #214 Confirmed

Qwen2.5 32B Instruct Alibaba (Qwen)

30.1

Rank #297 Confirmed

Summary

  • The widest gap is in math, where Granite 4.0 H Small leads 31.4 to 16.2.

Side by side

Granite 4.0 H Small and Qwen2.5 32B Instruct specifications
Granite 4.0 H SmallQwen2.5 32B Instruct
ProviderIBMAlibaba (Qwen)
Noometry Index36.530.1
Released—2024-09
WeightsOpenOpen
Context window—131K
Max output—8K
Input $ / M tokens—$0.70
Output $ / M tokens—$2.80
Results tracked197

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen2.5 32B Instruct leads

Granite 4.0 H Small: 36.4 (#209), Qwen2.5 32B Instruct: 38.7 (#169)

Coding benchmarks
BenchmarkGranite 4.0 H SmallQwen2.5 32B Instruct
BigCodeBench Instruct—45%
LMArena Coding1249—
BigCodeBench Complete—52.3%

Reasoning Granite 4.0 H Small leads

Granite 4.0 H Small: 24.4 (#163), Qwen2.5 32B Instruct: 19.2 (#266)

Reasoning benchmarks
BenchmarkGranite 4.0 H SmallQwen2.5 32B Instruct
Chess Puzzles—0%
LMArena Hard Prompts1240—
Epoch Capabilities Index—128.52

Math Granite 4.0 H Small leads

Granite 4.0 H Small: 31.4 (#223), Qwen2.5 32B Instruct: 16.2 (#296)

Math benchmarks
BenchmarkGranite 4.0 H SmallQwen2.5 32B Instruct
OTIS Mock AIME 2024-2025—7.4%
Omni-MATH29.6%—
LMArena Math1247—
MATH Level 5—56.1%

Knowledge Granite 4.0 H Small leads

Granite 4.0 H Small: 32.0 (#215), Qwen2.5 32B Instruct: 24.9 (#266)

Knowledge benchmarks
BenchmarkGranite 4.0 H SmallQwen2.5 32B Instruct
GPQA Diamond—46.1%
MMLU-Pro56.9%—
Vectara Hallucination Rate5.2%—
GPQA (HELM)38.3%—
LMArena Expert1251—

Multilingual Not comparable

Granite 4.0 H Small: 38.6 (#228), Qwen2.5 32B Instruct: —

Multilingual benchmarks
BenchmarkGranite 4.0 H SmallQwen2.5 32B Instruct
LMArena Non-English1216—
LMArena Chinese1249—
LMArena Russian1201—
LMArena Spanish1258—

Instruction Following Not comparable

Granite 4.0 H Small: 68.7 (#183), Qwen2.5 32B Instruct: —

Instruction Following benchmarks
BenchmarkGranite 4.0 H SmallQwen2.5 32B Instruct
IFEval89%—
LMArena Instruction Following1222—

Long Context Not comparable

Granite 4.0 H Small: 37.7 (#213), Qwen2.5 32B Instruct: —

Long Context benchmarks
BenchmarkGranite 4.0 H SmallQwen2.5 32B Instruct
LMArena Longer Query1242—

Writing & Preference Not comparable

Granite 4.0 H Small: 43.8 (#227), Qwen2.5 32B Instruct: —

Writing & Preference benchmarks
BenchmarkGranite 4.0 H SmallQwen2.5 32B Instruct
LMArena Text1241—
LMArena Creative Writing1211—
WildBench73.9%—
LMArena Multi-Turn1242—

Frequently asked questions

Is Granite 4.0 H Small better than Qwen2.5 32B Instruct?

Granite 4.0 H Small is the stronger model overall, scoring 36.5 to 30.1 on the Noometry Index.

Is Granite 4.0 H Small or Qwen2.5 32B Instruct better for coding?

Qwen2.5 32B Instruct scores higher on coding benchmarks: 38.7 versus 36.4 in the Noometry coding category.

How many benchmarks do Granite 4.0 H Small and Qwen2.5 32B Instruct share?

0 benchmarks have published results for both models. Granite 4.0 H Small has 19 scored results on Noometry and Qwen2.5 32B Instruct has 7.

Related comparisons

Go deeper