Noometry

Model comparison

Granite 3.1 8b Instruct vs Ministral 3B

Granite 3.1 8b Instruct is the stronger model overall, scoring 32.4 to 26.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Granite 3.1 8b Instruct IBM

32.4

Rank #258 Confirmed

Ministral 3B Mistral AI

26.2

Rank #338 Confirmed

Summary

  • The widest gap is in knowledge, where Granite 3.1 8b Instruct leads 31.1 to 10.4.

Side by side

Granite 3.1 8b InstructMinistral 3B
ProviderIBMMistral AI
Noometry Index32.426.2
Released—2024-10-01
WeightsOpenOpen
Context window—131K
Max output—262K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.10
Results tracked136

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Granite 3.1 8b Instruct: 34.5 (#233), Ministral 3B: —

BenchmarkGranite 3.1 8b InstructMinistral 3B
LMArena Coding1186—

Agentic & Tool Use Not comparable

Granite 3.1 8b Instruct: 24.1 (#120), Ministral 3B: —

BenchmarkGranite 3.1 8b InstructMinistral 3B
Berkeley Function Calling Leaderboard27.1%—

Reasoning Granite 3.1 8b Instruct leads

Granite 3.1 8b Instruct: 22.1 (#207), Ministral 3B: 18.4 (#282)

BenchmarkGranite 3.1 8b InstructMinistral 3B
LMArena Hard Prompts1145—
DTBench—51.7%
LMCA—5.5%
Epoch Capabilities Index—118.1

Math Granite 3.1 8b Instruct leads

Granite 3.1 8b Instruct: 33.0 (#209), Ministral 3B: 26.6 (#258)

BenchmarkGranite 3.1 8b InstructMinistral 3B
LMArena Math1152—
MATH Level 5—14.4%

Knowledge Granite 3.1 8b Instruct leads

Granite 3.1 8b Instruct: 31.1 (#220), Ministral 3B: 10.4 (#302)

BenchmarkGranite 3.1 8b InstructMinistral 3B
GPQA Diamond—25.3%
Vectara Hallucination Rate—7.3%
LMArena Expert1142—

Multilingual Not comparable

Granite 3.1 8b Instruct: 30.9 (#260), Ministral 3B: —

BenchmarkGranite 3.1 8b InstructMinistral 3B
LMArena Non-English1099—
LMArena Chinese1145—
LMArena Russian1092—

Instruction Following Not comparable

Granite 3.1 8b Instruct: 58.6 (#259), Ministral 3B: —

BenchmarkGranite 3.1 8b InstructMinistral 3B
LMArena Instruction Following1131—

Long Context Not comparable

Granite 3.1 8b Instruct: 35.2 (#241), Ministral 3B: —

BenchmarkGranite 3.1 8b InstructMinistral 3B
LMArena Longer Query1162—

Writing & Preference Not comparable

Granite 3.1 8b Instruct: 35.5 (#266), Ministral 3B: —

BenchmarkGranite 3.1 8b InstructMinistral 3B
LMArena Text1150—
LMArena Creative Writing1129—
LMArena Multi-Turn1108—

Frequently asked questions

Is Granite 3.1 8b Instruct better than Ministral 3B?

Granite 3.1 8b Instruct is the stronger model overall, scoring 32.4 to 26.2 on the Noometry Index.

How many benchmarks do Granite 3.1 8b Instruct and Ministral 3B share?

0 benchmarks have published results for both models. Granite 3.1 8b Instruct has 13 scored results on Noometry and Ministral 3B has 6.

Related comparisons

Go deeper