Noometry

Model comparison

GPT-4 Turbo vs Granite 4.2 8B

Granite 4.2 8B is the stronger model overall, scoring 40.5 to 30.5 on the Noometry Index.

Last verified . 11 shared benchmarks.

GPT-4 Turbo OpenAI

30.5

Rank #292 Confirmed

Granite 4.2 8B IBM

40.5

Rank #148 Confirmed

Summary

  • They share 11 benchmarks with published results for both. GPT-4 Turbo scores higher in 0 categories and Granite 4.2 8B in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Granite 4.2 8B leads 38.4 to 24.3.
  • Granite 4.2 8B is cheaper at $0.06 / $0.25 per million input/output tokens, against $10 / $30 for GPT-4 Turbo.
  • Granite 4.2 8B accepts more context: 131K tokens versus 128K.
  • Granite 4.2 8B has downloadable open weights; the other is API-only.

Side by side

GPT-4 TurboGranite 4.2 8B
ProviderOpenAIIBM
Noometry Index30.540.5
Released2023-11-06—
WeightsProprietaryOpen
Context window128K131K
Max output4K118K
Input $ / M tokens$10$0.06
Output $ / M tokens$30$0.25
Results tracked3611

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.2 8B leads

GPT-4 Turbo: 33.8 (#249), Granite 4.2 8B: 40.5 (#137)

BenchmarkGPT-4 TurboGranite 4.2 8B
LMArena Coding12681380
WeirdML18%—
BigCodeBench Instruct48.2%—
BigCodeBench Complete58.2%—
HumanEval+86.6%—
MBPP+73.3%—

Agentic & Tool Use Not comparable

GPT-4 Turbo: —, Granite 4.2 8B: —

BenchmarkGPT-4 TurboGranite 4.2 8B
METR Time Horizons36.7%—

Reasoning Granite 4.2 8B leads

GPT-4 Turbo: 15.3 (#317), Granite 4.2 8B: 26.6 (#131)

BenchmarkGPT-4 TurboGranite 4.2 8B
LMArena Hard Prompts12511329
SimpleBench25.1%—
Chess Puzzles6%—
DTBench61.6%—
LMCA9.8%—
Epoch Capabilities Index127.25—
ForecastBench59.4—

Math Not comparable

GPT-4 Turbo: 9.0 (#322), Granite 4.2 8B: —

BenchmarkGPT-4 TurboGranite 4.2 8B
FrontierMath (Tiers 1-3)0.7%—
OTIS Mock AIME 2024-20256.7%—
LMArena Math1272—
MATH Level 546.7%—

Knowledge Granite 4.2 8B leads

GPT-4 Turbo: 24.3 (#268), Granite 4.2 8B: 38.4 (#145)

BenchmarkGPT-4 TurboGranite 4.2 8B
LMArena Expert12231384
GPQA Diamond46.6%—
Confabulations28.4%—
MMLU81.3%—

Multimodal Not comparable

GPT-4 Turbo: 30.6 (#110), Granite 4.2 8B: —

BenchmarkGPT-4 TurboGranite 4.2 8B
LMArena Vision1090—

Multilingual Granite 4.2 8B leads

GPT-4 Turbo: 40.5 (#216), Granite 4.2 8B: 44.5 (#178)

BenchmarkGPT-4 TurboGranite 4.2 8B
LMArena Non-English12451302
LMArena Chinese12421366
LMArena Russian12591285
LMArena French1276—
LMArena German1259—
LMArena Japanese1194—
LMArena Korean1187—
LMArena Spanish1260—

Instruction Following Granite 4.2 8B leads

GPT-4 Turbo: 65.8 (#216), Granite 4.2 8B: 68.7 (#184)

BenchmarkGPT-4 TurboGranite 4.2 8B
LMArena Instruction Following12491301

Long Context Granite 4.2 8B leads

GPT-4 Turbo: 38.0 (#206), Granite 4.2 8B: 40.3 (#159)

BenchmarkGPT-4 TurboGranite 4.2 8B
LMArena Longer Query12541324

Writing & Preference Granite 4.2 8B leads

GPT-4 Turbo: 47.7 (#206), Granite 4.2 8B: 49.6 (#189)

BenchmarkGPT-4 TurboGranite 4.2 8B
LMArena Text12721320
LMArena Creative Writing12691236
LMArena Multi-Turn12671301

Frequently asked questions

Is GPT-4 Turbo better than Granite 4.2 8B?

Granite 4.2 8B is the stronger model overall, scoring 40.5 to 30.5 on the Noometry Index.

Which is cheaper, GPT-4 Turbo or Granite 4.2 8B?

Granite 4.2 8B is cheaper. It lists at $0.06 per million input tokens and $0.25 per million output tokens; GPT-4 Turbo lists at $10 and $30.

Is GPT-4 Turbo or Granite 4.2 8B better for coding?

Granite 4.2 8B scores higher on coding benchmarks: 40.5 versus 33.8 in the Noometry coding category.

Which has the bigger context window?

Granite 4.2 8B does, with 131K tokens against 128K.

How many benchmarks do GPT-4 Turbo and Granite 4.2 8B share?

11 benchmarks have published results for both models. GPT-4 Turbo has 36 scored results on Noometry and Granite 4.2 8B has 11.

Related comparisons

Go deeper