Model comparison

GPT-5.4 vs Granite 4.0 Micro

GPT-5.4 is the stronger model overall, scoring 59.4 to 29.0 on the Noometry Index. Granite 4.0 Micro costs 138× less per token, which makes it the better buy when GPT-5.4's lead doesn't matter for your workload.

Last verified . 3 shared benchmarks.

GPT-5.4 OpenAI

59.4

Rank #16 Confirmed

Granite 4.0 Micro IBM

29.0

Rank #318 Confirmed

Summary

  • They share 3 benchmarks with published results for both. GPT-5.4 scores higher in 5 categories and Granite 4.0 Micro in 0 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.4 leads 73.5 to 12.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 97.8% for GPT-5.4 and 2.8% for Granite 4.0 Micro.
  • Granite 4.0 Micro is cheaper at $0.017 / $0.11 per million input/output tokens, against $2.50 / $15 for GPT-5.4.
  • GPT-5.4 accepts more context: 1.05M tokens versus 131K.
  • Granite 4.0 Micro has downloadable open weights; the other is API-only.

Side by side

GPT-5.4 and Granite 4.0 Micro specifications
GPT-5.4Granite 4.0 Micro
ProviderOpenAIIBM
Noometry Index59.429.0
Released2026-03-052025-10-02
WeightsProprietaryOpen
Context window1.05M131K
Max output128K118K
Input $ / M tokens$2.50$0.017
Output $ / M tokens$15$0.11
Results tracked688

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

GPT-5.4: 52.6 (#33), Granite 4.0 Micro: —

Coding benchmarks
BenchmarkGPT-5.4Granite 4.0 Micro
SWE-bench Verified76.9%—
DeepSWE51.8%—
LMArena WebDev1465—
SciCode56.6%—
GSO31.4%—
WeirdML77.7%—
LMArena Coding1497—
MirrorCode15.6%—
ALE-Bench1,607—
AlgoTune1.85—

Agentic & Tool Use Not comparable

GPT-5.4: 46.5 (#13), Granite 4.0 Micro: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.4Granite 4.0 Micro
Terminal-Bench81.8%—
APEX-Agents52.4%—
τ²-bench Banking39.4%—
DeepResearch Bench35.1%—
PostTrainBench19%—
GBAEval45.1%—
LMArena Search1197—
METR Time Horizons74.3%—
Vending-Bench 26,144—

Reasoning GPT-5.4 leads

GPT-5.4: 61.8 (#19), Granite 4.0 Micro: 19.2 (#265)

Reasoning benchmarks
BenchmarkGPT-5.4Granite 4.0 Micro
Chess Puzzles44%0%
ARC-AGI-274%—
Kagi LLM Benchmark63.8%—
NYT Connections (extended)91.3%—
ARC-AGI-193.7%—
CritPt23.4%—
EnigmaEval16%—
Thematic Generalization80%—
EBR-Bench25.4%—
LMArena Hard Prompts1485—
Mystery Game Puzzles37%—
DTBench94.4%—
LMCA52%—
Epoch Capabilities Index156.81—
ForecastBench59.5—

Math GPT-5.4 leads

GPT-5.4: 73.5 (#19), Granite 4.0 Micro: 12.0 (#307)

Knowledge GPT-5.4 leads

GPT-5.4: 65.3 (#14), Granite 4.0 Micro: 9.9 (#304)

Knowledge benchmarks
BenchmarkGPT-5.4Granite 4.0 Micro
GPQA Diamond93.3%28.3%
Humanity's Last Exam36.2%—
SimpleQA Verified45.1%—
MMLU-Pro—39.5%
Vectara Hallucination Rate7%—
GPQA (HELM)—30.7%
LMArena Expert1507—

Multimodal Not comparable

GPT-5.4: 43.7 (#20), Granite 4.0 Micro: —

Multimodal benchmarks
BenchmarkGPT-5.4Granite 4.0 Micro
LMArena Vision1303—
Blueprint-Bench 227.1%—
Furniture Assembly37.5%—
LMArena Document1471—

Multilingual Not comparable

GPT-5.4: 56.2 (#23), Granite 4.0 Micro: —

Multilingual benchmarks
BenchmarkGPT-5.4Granite 4.0 Micro
LMArena Non-English1465—
LMArena Chinese1519—
LMArena French1493—
LMArena German1472—
LMArena Japanese1485—
LMArena Korean1448—
LMArena Russian1480—
LMArena Spanish1454—

Instruction Following GPT-5.4 leads

GPT-5.4: 77.1 (#27), Granite 4.0 Micro: 69.9 (#169)

Instruction Following benchmarks
BenchmarkGPT-5.4Granite 4.0 Micro
IFEval—84.9%
LMArena Instruction Following1469—

Long Context Not comparable

GPT-5.4: 50.3 (#8), Granite 4.0 Micro: —

Long Context benchmarks
BenchmarkGPT-5.4Granite 4.0 Micro
CL-bench27.9%—
CL-bench Life21.7%—
LMArena Longer Query1473—

Writing & Preference GPT-5.4 leads

GPT-5.4: 71.9 (#17), Granite 4.0 Micro: 46.7 (#216)

Writing & Preference benchmarks
BenchmarkGPT-5.4Granite 4.0 Micro
LMArena Text1469—
LMArena Creative Writing1439—
EQ-Bench Creative Writing1840—
WildBench—67%
EQ-Bench 41272—
LMArena Multi-Turn1482—

Frequently asked questions

Is GPT-5.4 better than Granite 4.0 Micro?

GPT-5.4 is the stronger model overall, scoring 59.4 to 29.0 on the Noometry Index. Granite 4.0 Micro costs 138× less per token, which makes it the better buy when GPT-5.4's lead doesn't matter for your workload.

Which is cheaper, GPT-5.4 or Granite 4.0 Micro?

Granite 4.0 Micro is cheaper. It lists at $0.017 per million input tokens and $0.11 per million output tokens; GPT-5.4 lists at $2.50 and $15.

Which has the bigger context window?

GPT-5.4 does, with 1.05M tokens against 131K.

How many benchmarks do GPT-5.4 and Granite 4.0 Micro share?

3 benchmarks have published results for both models. GPT-5.4 has 68 scored results on Noometry and Granite 4.0 Micro has 8.

Related comparisons

Go deeper