Noometry

Model comparison

Granite 4.1 8b vs Ministral 3B

Granite 4.1 8b is the stronger model overall, scoring 37.4 to 26.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Granite 4.1 8b IBM

37.4

Rank #205 Confirmed

Ministral 3B Mistral AI

26.2

Rank #338 Confirmed

Summary

  • The widest gap is in knowledge, where Granite 4.1 8b leads 36.1 to 10.4.

Side by side

Granite 4.1 8bMinistral 3B
ProviderIBMMistral AI
Noometry Index37.426.2
Released—2024-10-01
WeightsOpenOpen
Context window—131K
Max output—262K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.10
Results tracked136

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Granite 4.1 8b: 30.1 (#297), Ministral 3B: —

BenchmarkGranite 4.1 8bMinistral 3B
LMArena WebDev1192—
LMArena Coding1312—

Reasoning Granite 4.1 8b leads

Granite 4.1 8b: 25.7 (#143), Ministral 3B: 18.4 (#282)

BenchmarkGranite 4.1 8bMinistral 3B
LMArena Hard Prompts1293—
DTBench—51.7%
LMCA—5.5%
Epoch Capabilities Index—118.1

Math Granite 4.1 8b leads

Granite 4.1 8b: 36.4 (#166), Ministral 3B: 26.6 (#258)

BenchmarkGranite 4.1 8bMinistral 3B
LMArena Math1312—
MATH Level 5—14.4%

Knowledge Granite 4.1 8b leads

Granite 4.1 8b: 36.1 (#174), Ministral 3B: 10.4 (#302)

BenchmarkGranite 4.1 8bMinistral 3B
GPQA Diamond—25.3%
Vectara Hallucination Rate—7.3%
LMArena Expert1309—

Multilingual Not comparable

Granite 4.1 8b: 41.7 (#204), Ministral 3B: —

BenchmarkGranite 4.1 8bMinistral 3B
LMArena Non-English1261—
LMArena Chinese1337—
LMArena Russian1240—

Instruction Following Not comparable

Granite 4.1 8b: 66.9 (#203), Ministral 3B: —

BenchmarkGranite 4.1 8bMinistral 3B
LMArena Instruction Following1269—

Long Context Not comparable

Granite 4.1 8b: 38.7 (#193), Ministral 3B: —

BenchmarkGranite 4.1 8bMinistral 3B
LMArena Longer Query1275—

Writing & Preference Not comparable

Granite 4.1 8b: 48.1 (#204), Ministral 3B: —

BenchmarkGranite 4.1 8bMinistral 3B
LMArena Text1290—
LMArena Creative Writing1251—
LMArena Multi-Turn1268—

Frequently asked questions

Is Granite 4.1 8b better than Ministral 3B?

Granite 4.1 8b is the stronger model overall, scoring 37.4 to 26.2 on the Noometry Index.

How many benchmarks do Granite 4.1 8b and Ministral 3B share?

0 benchmarks have published results for both models. Granite 4.1 8b has 13 scored results on Noometry and Ministral 3B has 6.

Related comparisons

Go deeper