Model comparison

Granite 4.0 H Small vs Sonar

Sonar is the stronger model overall, scoring 38.5 to 36.5 on the Noometry Index.

Last verified . 0 shared benchmarks.

Granite 4.0 H Small IBM

36.5

Rank #214 Confirmed

Sonar Perplexity

38.5

Rank #187 Confirmed

Summary

  • The widest gap is in writing & preference, where Sonar leads 52.6 to 43.8.
  • Granite 4.0 H Small has downloadable open weights; the other is API-only.

Side by side

Granite 4.0 H Small and Sonar specifications
Granite 4.0 H SmallSonar
ProviderIBMPerplexity
Noometry Index36.538.5
Released—2024-01-01
WeightsOpenProprietary
Context window—128K
Max output—4K
Input $ / M tokens—$1
Output $ / M tokens—$1
Results tracked197

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Granite 4.0 H Small: 36.4 (#209), Sonar: 35.7 (#221)

Coding benchmarks
BenchmarkGranite 4.0 H SmallSonar
LiveBench Coding—35.1%
LMArena Coding1249—

Reasoning Granite 4.0 H Small leads

Granite 4.0 H Small: 24.4 (#163), Sonar: 21.1 (#227)

Reasoning benchmarks
BenchmarkGranite 4.0 H SmallSonar
LiveBench Reasoning—46.3%
LMArena Hard Prompts1240—
LiveBench Data Analysis—37.9%
LiveBench—46.9%

Math Sonar leads

Granite 4.0 H Small: 31.4 (#223), Sonar: 33.7 (#200)

Math benchmarks
BenchmarkGranite 4.0 H SmallSonar
Omni-MATH29.6%—
LiveBench Math—41.6%
LMArena Math1247—

Knowledge Not comparable

Granite 4.0 H Small: 32.0 (#215), Sonar: —

Knowledge benchmarks
BenchmarkGranite 4.0 H SmallSonar
MMLU-Pro56.9%—
Vectara Hallucination Rate5.2%—
GPQA (HELM)38.3%—
LMArena Expert1251—

Multilingual Not comparable

Granite 4.0 H Small: 38.6 (#228), Sonar: —

Multilingual benchmarks
BenchmarkGranite 4.0 H SmallSonar
LMArena Non-English1216—
LMArena Chinese1249—
LMArena Russian1201—
LMArena Spanish1258—

Instruction Following Sonar leads

Granite 4.0 H Small: 68.7 (#183), Sonar: 71.4 (#150)

Instruction Following benchmarks
BenchmarkGranite 4.0 H SmallSonar
LiveBench Instruction Following—76.2%
IFEval89%—
LMArena Instruction Following1222—

Long Context Not comparable

Granite 4.0 H Small: 37.7 (#213), Sonar: —

Long Context benchmarks
BenchmarkGranite 4.0 H SmallSonar
LMArena Longer Query1242—

Writing & Preference Sonar leads

Granite 4.0 H Small: 43.8 (#227), Sonar: 52.6 (#167)

Writing & Preference benchmarks
BenchmarkGranite 4.0 H SmallSonar
LMArena Text1241—
LMArena Creative Writing1211—
WildBench73.9%—
LMArena Multi-Turn1242—
LiveBench Language—44.1%

Frequently asked questions

Is Granite 4.0 H Small better than Sonar?

Sonar is the stronger model overall, scoring 38.5 to 36.5 on the Noometry Index.

Is Granite 4.0 H Small or Sonar better for coding?

They score almost the same on coding (36.4 vs 35.7); test both on your own repository before choosing.

How many benchmarks do Granite 4.0 H Small and Sonar share?

0 benchmarks have published results for both models. Granite 4.0 H Small has 19 scored results on Noometry and Sonar has 7.

Related comparisons

Go deeper