Model comparison

Granite 4.0 Micro vs Grok 2 Mini 2024 08 13

Grok 2 Mini 2024 08 13 is the stronger model overall, scoring 37.7 to 29.0 on the Noometry Index.

Last verified . 0 shared benchmarks.

Granite 4.0 Micro IBM

29.0

Rank #318 Confirmed

Grok 2 Mini 2024 08 13 xAI

37.7

Rank #198 Confirmed

Summary

  • The widest gap is in knowledge, where Grok 2 Mini 2024 08 13 leads 33.9 to 9.9.
  • Granite 4.0 Micro has downloadable open weights; the other is API-only.

Side by side

Granite 4.0 Micro and Grok 2 Mini 2024 08 13 specifications
Granite 4.0 MicroGrok 2 Mini 2024 08 13
ProviderIBMxAI
Noometry Index29.037.7
Released2025-10-022024-08-13
WeightsOpenProprietary
Context window131K—
Max output118K—
Input $ / M tokens$0.017—
Output $ / M tokens$0.11—
Results tracked817

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Granite 4.0 Micro: —, Grok 2 Mini 2024 08 13: 37.0 (#199)

Coding benchmarks
BenchmarkGranite 4.0 MicroGrok 2 Mini 2024 08 13
LMArena Coding—1269

Reasoning Grok 2 Mini 2024 08 13 leads

Granite 4.0 Micro: 19.2 (#265), Grok 2 Mini 2024 08 13: 24.8 (#159)

Reasoning benchmarks
BenchmarkGranite 4.0 MicroGrok 2 Mini 2024 08 13
Chess Puzzles0%—
LMArena Hard Prompts—1255

Math Grok 2 Mini 2024 08 13 leads

Granite 4.0 Micro: 12.0 (#307), Grok 2 Mini 2024 08 13: 35.4 (#185)

Math benchmarks
BenchmarkGranite 4.0 MicroGrok 2 Mini 2024 08 13
OTIS Mock AIME 2024-20252.8%—
Omni-MATH20.9%—
LMArena Math—1265

Knowledge Grok 2 Mini 2024 08 13 leads

Granite 4.0 Micro: 9.9 (#304), Grok 2 Mini 2024 08 13: 33.9 (#200)

Knowledge benchmarks
BenchmarkGranite 4.0 MicroGrok 2 Mini 2024 08 13
GPQA Diamond28.3%—
MMLU-Pro39.5%—
GPQA (HELM)30.7%—
LMArena Expert—1238

Multilingual Not comparable

Granite 4.0 Micro: —, Grok 2 Mini 2024 08 13: 41.4 (#208)

Multilingual benchmarks
BenchmarkGranite 4.0 MicroGrok 2 Mini 2024 08 13
LMArena Non-English—1257
LMArena Chinese—1262
LMArena French—1286
LMArena German—1273
LMArena Japanese—1213
LMArena Korean—1195
LMArena Russian—1261
LMArena Spanish—1279

Instruction Following Granite 4.0 Micro leads

Granite 4.0 Micro: 69.9 (#169), Grok 2 Mini 2024 08 13: 65.5 (#220)

Instruction Following benchmarks
BenchmarkGranite 4.0 MicroGrok 2 Mini 2024 08 13
IFEval84.9%—
LMArena Instruction Following—1245

Long Context Not comparable

Granite 4.0 Micro: —, Grok 2 Mini 2024 08 13: 38.4 (#196)

Long Context benchmarks
BenchmarkGranite 4.0 MicroGrok 2 Mini 2024 08 13
LMArena Longer Query—1266

Writing & Preference Too close to call

Granite 4.0 Micro: 46.7 (#216), Grok 2 Mini 2024 08 13: 47.3 (#211)

Writing & Preference benchmarks
BenchmarkGranite 4.0 MicroGrok 2 Mini 2024 08 13
LMArena Text—1281
LMArena Creative Writing—1242
WildBench67%—
LMArena Multi-Turn—1265

Frequently asked questions

Is Granite 4.0 Micro better than Grok 2 Mini 2024 08 13?

Grok 2 Mini 2024 08 13 is the stronger model overall, scoring 37.7 to 29.0 on the Noometry Index.

How many benchmarks do Granite 4.0 Micro and Grok 2 Mini 2024 08 13 share?

0 benchmarks have published results for both models. Granite 4.0 Micro has 8 scored results on Noometry and Grok 2 Mini 2024 08 13 has 17.

Related comparisons

Go deeper