Noometry

Model comparison

Granite 4.0 Micro vs Mixtral 8x22B

Granite 4.0 Micro is the stronger model overall, scoring 29.0 to 27.1 on the Noometry Index.

Last verified . 6 shared benchmarks.

Granite 4.0 Micro IBM

29.0

Rank #318 Confirmed

Mixtral 8x22B Mistral AI

27.1

Rank #333 Confirmed

Summary

  • They share 6 benchmarks with published results for both. Granite 4.0 Micro scores higher in 2 categories and Mixtral 8x22B in 3 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in instruction following, where Granite 4.0 Micro leads 69.9 to 57.7.
  • The biggest single-benchmark swing is IFEval: 84.9% for Granite 4.0 Micro and 72.4% for Mixtral 8x22B.
  • Granite 4.0 Micro is cheaper at $0.017 / $0.11 per million input/output tokens, against $2 / $6 for Mixtral 8x22B.
  • Granite 4.0 Micro accepts more context: 131K tokens versus 64K.

Side by side

Granite 4.0 MicroMixtral 8x22B
ProviderIBMMistral AI
Noometry Index29.027.1
Released2025-10-022024-04-17
WeightsOpenOpen
Context window131K64K
Max output118K64K
Input $ / M tokens$0.017$2
Output $ / M tokens$0.11$6
Results tracked834

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Granite 4.0 Micro: —, Mixtral 8x22B: 24.2 (#329)

BenchmarkGranite 4.0 MicroMixtral 8x22B
WeirdML—3.2%
BigCodeBench Instruct—40.6%
LMArena Coding—1166
BigCodeBench Complete—50.2%
HumanEval+—72%
MBPP+—64.3%

Agentic & Tool Use Not comparable

Granite 4.0 Micro: —, Mixtral 8x22B: 23.1 (#127)

BenchmarkGranite 4.0 MicroMixtral 8x22B
Cybench—7.5%

Reasoning Too close to call

Granite 4.0 Micro: 19.2 (#265), Mixtral 8x22B: 19.9 (#248)

BenchmarkGranite 4.0 MicroMixtral 8x22B
Chess Puzzles0%—
LMArena Hard Prompts—1150
DTBench—55.1%
Epoch Capabilities Index—122.03
ForecastBench—56.3

Math Mixtral 8x22B leads

Granite 4.0 Micro: 12.0 (#307), Mixtral 8x22B: 22.9 (#275)

BenchmarkGranite 4.0 MicroMixtral 8x22B
Omni-MATH20.9%16.3%
OTIS Mock AIME 2024-20252.8%—
LMArena Math—1184
MATH Level 5—24.2%

Knowledge Mixtral 8x22B leads

Granite 4.0 Micro: 9.9 (#304), Mixtral 8x22B: 15.1 (#293)

BenchmarkGranite 4.0 MicroMixtral 8x22B
GPQA Diamond28.3%34.1%
MMLU-Pro39.5%46%
GPQA (HELM)30.7%33.4%
LMArena Expert—1113
MMLU—77.8%

Multilingual Not comparable

Granite 4.0 Micro: —, Mixtral 8x22B: 32.8 (#255)

BenchmarkGranite 4.0 MicroMixtral 8x22B
LMArena Non-English—1128
LMArena Chinese—1116
LMArena French—1166
LMArena German—1141
LMArena Japanese—1037
LMArena Korean—1057
LMArena Russian—1158
LMArena Spanish—1151

Instruction Following Granite 4.0 Micro leads

Granite 4.0 Micro: 69.9 (#169), Mixtral 8x22B: 57.7 (#266)

BenchmarkGranite 4.0 MicroMixtral 8x22B
IFEval84.9%72.4%
LMArena Instruction Following—1147

Long Context Not comparable

Granite 4.0 Micro: —, Mixtral 8x22B: 34.7 (#247)

BenchmarkGranite 4.0 MicroMixtral 8x22B
LMArena Longer Query—1144

Writing & Preference Granite 4.0 Micro leads

Granite 4.0 Micro: 46.7 (#216), Mixtral 8x22B: 36.9 (#262)

BenchmarkGranite 4.0 MicroMixtral 8x22B
WildBench67%71.1%
LMArena Text—1162
LMArena Creative Writing—1141
LMArena Multi-Turn—1130

Frequently asked questions

Is Granite 4.0 Micro better than Mixtral 8x22B?

Granite 4.0 Micro is the stronger model overall, scoring 29.0 to 27.1 on the Noometry Index.

Which is cheaper, Granite 4.0 Micro or Mixtral 8x22B?

Granite 4.0 Micro is cheaper. It lists at $0.017 per million input tokens and $0.11 per million output tokens; Mixtral 8x22B lists at $2 and $6.

Which has the bigger context window?

Granite 4.0 Micro does, with 131K tokens against 64K.

How many benchmarks do Granite 4.0 Micro and Mixtral 8x22B share?

6 benchmarks have published results for both models. Granite 4.0 Micro has 8 scored results on Noometry and Mixtral 8x22B has 34.

Related comparisons

Go deeper