Model comparison

Granite 4.0 H Small vs Qwen1.5 4b Chat

Granite 4.0 H Small is the stronger model overall, scoring 36.5 to 28.8 on the Noometry Index.

Last verified . 12 shared benchmarks.

Granite 4.0 H Small IBM

36.5

Rank #214 Confirmed

Qwen1.5 4b Chat Alibaba (Qwen)

28.8

Rank #322 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Granite 4.0 H Small scores higher in 8 categories and Qwen1.5 4b Chat in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Granite 4.0 H Small leads 43.8 to 23.8.

Side by side

Granite 4.0 H Small and Qwen1.5 4b Chat specifications
Granite 4.0 H SmallQwen1.5 4b Chat
ProviderIBMAlibaba (Qwen)
Noometry Index36.528.8
Released——
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1913

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.0 H Small leads

Granite 4.0 H Small: 36.4 (#209), Qwen1.5 4b Chat: 29.1 (#308)

Coding benchmarks
BenchmarkGranite 4.0 H SmallQwen1.5 4b Chat
LMArena Coding1249999

Reasoning Granite 4.0 H Small leads

Granite 4.0 H Small: 24.4 (#163), Qwen1.5 4b Chat: 18.5 (#279)

Reasoning benchmarks
BenchmarkGranite 4.0 H SmallQwen1.5 4b Chat
LMArena Hard Prompts1240976

Math Granite 4.0 H Small leads

Granite 4.0 H Small: 31.4 (#223), Qwen1.5 4b Chat: 30.4 (#234)

Math benchmarks
BenchmarkGranite 4.0 H SmallQwen1.5 4b Chat
LMArena Math12471026
Omni-MATH29.6%—

Knowledge Granite 4.0 H Small leads

Granite 4.0 H Small: 32.0 (#215), Qwen1.5 4b Chat: 26.7 (#255)

Knowledge benchmarks
BenchmarkGranite 4.0 H SmallQwen1.5 4b Chat
LMArena Expert1251980
MMLU-Pro56.9%—
Vectara Hallucination Rate5.2%—
GPQA (HELM)38.3%—

Multilingual Granite 4.0 H Small leads

Granite 4.0 H Small: 38.6 (#228), Qwen1.5 4b Chat: 24.1 (#290)

Multilingual benchmarks
BenchmarkGranite 4.0 H SmallQwen1.5 4b Chat
LMArena Non-English1216979
LMArena Chinese12491024
LMArena Russian1201952
LMArena German—902
LMArena Spanish1258—

Instruction Following Granite 4.0 H Small leads

Granite 4.0 H Small: 68.7 (#183), Qwen1.5 4b Chat: 49.0 (#300)

Instruction Following benchmarks
BenchmarkGranite 4.0 H SmallQwen1.5 4b Chat
LMArena Instruction Following1222978
IFEval89%—

Long Context Granite 4.0 H Small leads

Granite 4.0 H Small: 37.7 (#213), Qwen1.5 4b Chat: 30.1 (#290)

Long Context benchmarks
BenchmarkGranite 4.0 H SmallQwen1.5 4b Chat
LMArena Longer Query1242988

Writing & Preference Granite 4.0 H Small leads

Granite 4.0 H Small: 43.8 (#227), Qwen1.5 4b Chat: 23.8 (#309)

Writing & Preference benchmarks
BenchmarkGranite 4.0 H SmallQwen1.5 4b Chat
LMArena Text1241997
LMArena Creative Writing1211969
LMArena Multi-Turn1242977
WildBench73.9%—

Frequently asked questions

Is Granite 4.0 H Small better than Qwen1.5 4b Chat?

Granite 4.0 H Small is the stronger model overall, scoring 36.5 to 28.8 on the Noometry Index.

Is Granite 4.0 H Small or Qwen1.5 4b Chat better for coding?

Granite 4.0 H Small scores higher on coding benchmarks: 36.4 versus 29.1 in the Noometry coding category.

How many benchmarks do Granite 4.0 H Small and Qwen1.5 4b Chat share?

12 benchmarks have published results for both models. Granite 4.0 H Small has 19 scored results on Noometry and Qwen1.5 4b Chat has 13.

Related comparisons

Go deeper