Model comparison

Chatgpt 4o Latest 20250326 vs Granite 4.0 H Small

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.2 to 35.9 on the Noometry Index.

Last verified . 13 shared benchmarks.

Chatgpt 4o Latest 20250326 OpenAI

43.2

Rank #84 Confirmed

Granite 4.0 H Small IBM

35.9

Rank #213 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Chatgpt 4o Latest 20250326 scores higher in 8 categories and Granite 4.0 H Small in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Chatgpt 4o Latest 20250326 leads 62.8 to 44.0.
  • Granite 4.0 H Small has downloadable open weights; the other is API-only.

Side by side

Chatgpt 4o Latest 20250326 and Granite 4.0 H Small specifications
Chatgpt 4o Latest 20250326Granite 4.0 H Small
ProviderOpenAIIBM
Noometry Index43.235.9
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2119

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 41.0 (#122), Granite 4.0 H Small: 35.8 (#207)

Coding benchmarks
BenchmarkChatgpt 4o Latest 20250326Granite 4.0 H Small
LMArena Coding14131247

Reasoning Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 32.8 (#64), Granite 4.0 H Small: 23.4 (#164)

Reasoning benchmarks
BenchmarkChatgpt 4o Latest 20250326Granite 4.0 H Small
LMArena Hard Prompts14241240
Kagi LLM Benchmark75%—

Math Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 35.8 (#134), Granite 4.0 H Small: 29.3 (#219)

Math benchmarks
BenchmarkChatgpt 4o Latest 20250326Granite 4.0 H Small
LMArena Math14071251
Omni-MATH—29.6%

Knowledge Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 38.7 (#131), Granite 4.0 H Small: 31.5 (#210)

Knowledge benchmarks
BenchmarkChatgpt 4o Latest 20250326Granite 4.0 H Small
LMArena Expert14001244
MMLU-Pro—56.9%
Confabulations16.6%—
Vectara Hallucination Rate—5.2%
GPQA (HELM)—38.3%

Multimodal Not comparable

Chatgpt 4o Latest 20250326: 38.9 (#54), Granite 4.0 H Small: —

Multimodal benchmarks
BenchmarkChatgpt 4o Latest 20250326Granite 4.0 H Small
LMArena Vision1243—

Multilingual Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 53.1 (#72), Granite 4.0 H Small: 38.7 (#223)

Multilingual benchmarks
BenchmarkChatgpt 4o Latest 20250326Granite 4.0 H Small
LMArena Non-English14191216
LMArena Chinese14561250
LMArena Russian14291198
LMArena Spanish14351258
LMArena French1447—
LMArena German1424—
LMArena Japanese1406—
LMArena Korean1397—

Instruction Following Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 74.2 (#102), Granite 4.0 H Small: 68.9 (#178)

Instruction Following benchmarks
BenchmarkChatgpt 4o Latest 20250326Granite 4.0 H Small
LMArena Instruction Following14031221
IFEval—89%

Long Context Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 43.1 (#104), Granite 4.0 H Small: 37.6 (#209)

Long Context benchmarks
BenchmarkChatgpt 4o Latest 20250326Granite 4.0 H Small
LMArena Longer Query14131240

Writing & Preference Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 62.8 (#68), Granite 4.0 H Small: 44.0 (#222)

Writing & Preference benchmarks
BenchmarkChatgpt 4o Latest 20250326Granite 4.0 H Small
LMArena Text14291241
LMArena Creative Writing14061210
LMArena Multi-Turn14541243
EQ-Bench Creative Writing1501—
WildBench—73.9%

Frequently asked questions

Is Chatgpt 4o Latest 20250326 better than Granite 4.0 H Small?

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.2 to 35.9 on the Noometry Index.

Is Chatgpt 4o Latest 20250326 or Granite 4.0 H Small better for coding?

Chatgpt 4o Latest 20250326 scores higher on coding benchmarks: 41.0 versus 35.8 in the Noometry coding category.

How many benchmarks do Chatgpt 4o Latest 20250326 and Granite 4.0 H Small share?

13 benchmarks have published results for both models. Chatgpt 4o Latest 20250326 has 21 scored results on Noometry and Granite 4.0 H Small has 19.

Related comparisons

Go deeper