Model comparison

Codestral vs Granite 4.1 8b

Granite 4.1 8b is the stronger model overall, scoring 36.8 to 30.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Codestral Mistral AI

30.1

Rank #287 Reported

Granite 4.1 8b IBM

36.8

Rank #202 Confirmed

Summary

  • The widest gap is in reasoning, where Granite 4.1 8b leads 24.6 to 19.1.

Side by side

Codestral and Granite 4.1 8b specifications
CodestralGranite 4.1 8b
ProviderMistral AIIBM
Noometry Index30.136.8
Released2024-05-29—
WeightsOpenOpen
Context window256K—
Max output4K—
Input $ / M tokens$0.30—
Output $ / M tokens$0.90—
Results tracked713

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.1 8b leads

Codestral: 26.9 (#316), Granite 4.1 8b: 29.9 (#291)

Coding benchmarks
BenchmarkCodestralGranite 4.1 8b
Aider Polyglot11.1%—
LMArena WebDev—1190
BigCodeBench Instruct41.8%—
LMArena Coding—1313
BigCodeBench Complete52.5%—
ALE-Bench137.78—
HumanEval+73.8%—
MBPP+61.9%—

Reasoning Granite 4.1 8b leads

Codestral: 19.1 (#244), Granite 4.1 8b: 24.6 (#142)

Reasoning benchmarks
BenchmarkCodestralGranite 4.1 8b
Kagi LLM Benchmark32.5%—
LMArena Hard Prompts—1294

Math Not comparable

Codestral: —, Granite 4.1 8b: 33.8 (#167)

Math benchmarks
BenchmarkCodestralGranite 4.1 8b
LMArena Math—1311

Knowledge Not comparable

Codestral: —, Granite 4.1 8b: 35.5 (#171)

Knowledge benchmarks
BenchmarkCodestralGranite 4.1 8b
LMArena Expert—1310

Multilingual Not comparable

Codestral: —, Granite 4.1 8b: 41.8 (#199)

Multilingual benchmarks
BenchmarkCodestralGranite 4.1 8b
LMArena Non-English—1261
LMArena Chinese—1335
LMArena Russian—1238

Instruction Following Not comparable

Codestral: —, Granite 4.1 8b: 67.0 (#198)

Instruction Following benchmarks
BenchmarkCodestralGranite 4.1 8b
LMArena Instruction Following—1268

Long Context Not comparable

Codestral: —, Granite 4.1 8b: 38.7 (#188)

Long Context benchmarks
BenchmarkCodestralGranite 4.1 8b
LMArena Longer Query—1275

Writing & Preference Not comparable

Codestral: —, Granite 4.1 8b: 48.3 (#199)

Writing & Preference benchmarks
BenchmarkCodestralGranite 4.1 8b
LMArena Text—1291
LMArena Creative Writing—1249
LMArena Multi-Turn—1269

Frequently asked questions

Is Codestral better than Granite 4.1 8b?

Granite 4.1 8b is the stronger model overall, scoring 36.8 to 30.1 on the Noometry Index.

Is Codestral or Granite 4.1 8b better for coding?

Granite 4.1 8b scores higher on coding benchmarks: 29.9 versus 26.9 in the Noometry coding category.

How many benchmarks do Codestral and Granite 4.1 8b share?

0 benchmarks have published results for both models. Codestral has 7 scored results on Noometry and Granite 4.1 8b has 13.

Related comparisons

Go deeper