Noometry

Model comparison

Granite 3.1 8b Instruct vs Mistral Small 3.1

Granite 3.1 8b Instruct and Mistral Small 3.1 score almost the same on the Noometry Index (32.4 vs 31.7), so choose on price, context window or the category you care about most.

Last verified . 12 shared benchmarks.

Granite 3.1 8b Instruct IBM

32.4

Rank #258 Confirmed

Mistral Small 3.1 Mistral AI

31.7

Rank #269 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Granite 3.1 8b Instruct scores higher in 3 categories and Mistral Small 3.1 in 5 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Granite 3.1 8b Instruct leads 33.0 to 14.7.

Side by side

Granite 3.1 8b InstructMistral Small 3.1
ProviderIBMMistral AI
Noometry Index32.431.7
Released—2025-03-17
WeightsOpenOpen
Context window—128K
Max output—102K
Input $ / M tokens—$0.35
Output $ / M tokens—$0.56
Results tracked1328

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Small 3.1 leads

Granite 3.1 8b Instruct: 34.5 (#233), Mistral Small 3.1: 38.3 (#179)

BenchmarkGranite 3.1 8b InstructMistral Small 3.1
LMArena Coding11861309

Agentic & Tool Use Not comparable

Granite 3.1 8b Instruct: 24.1 (#120), Mistral Small 3.1: —

BenchmarkGranite 3.1 8b InstructMistral Small 3.1
Berkeley Function Calling Leaderboard27.1%—

Reasoning Granite 3.1 8b Instruct leads

Granite 3.1 8b Instruct: 22.1 (#207), Mistral Small 3.1: 19.7 (#254)

BenchmarkGranite 3.1 8b InstructMistral Small 3.1
LMArena Hard Prompts11451278
Chess Puzzles—1%
Epoch Capabilities Index—127.48

Math Granite 3.1 8b Instruct leads

Granite 3.1 8b Instruct: 33.0 (#209), Mistral Small 3.1: 14.7 (#301)

BenchmarkGranite 3.1 8b InstructMistral Small 3.1
LMArena Math11521262
OTIS Mock AIME 2024-2025—3.9%
Omni-MATH—24.8%

Knowledge Granite 3.1 8b Instruct leads

Granite 3.1 8b Instruct: 31.1 (#220), Mistral Small 3.1: 22.6 (#271)

BenchmarkGranite 3.1 8b InstructMistral Small 3.1
LMArena Expert11421257
GPQA Diamond—41.9%
MMLU-Pro—61%
GPQA (HELM)—39.2%

Multimodal Not comparable

Granite 3.1 8b Instruct: —, Mistral Small 3.1: 33.2 (#99)

BenchmarkGranite 3.1 8b InstructMistral Small 3.1
LMArena Vision—1136

Multilingual Mistral Small 3.1 leads

Granite 3.1 8b Instruct: 30.9 (#260), Mistral Small 3.1: 41.2 (#209)

BenchmarkGranite 3.1 8b InstructMistral Small 3.1
LMArena Non-English10991255
LMArena Chinese11451253
LMArena Russian10921263
LMArena French—1273
LMArena German—1266
LMArena Japanese—1208
LMArena Korean—1206
LMArena Spanish—1283

Instruction Following Mistral Small 3.1 leads

Granite 3.1 8b Instruct: 58.6 (#259), Mistral Small 3.1: 63.6 (#230)

BenchmarkGranite 3.1 8b InstructMistral Small 3.1
LMArena Instruction Following11311264
IFEval—75%

Long Context Mistral Small 3.1 leads

Granite 3.1 8b Instruct: 35.2 (#241), Mistral Small 3.1: 39.5 (#178)

BenchmarkGranite 3.1 8b InstructMistral Small 3.1
LMArena Longer Query11621299

Writing & Preference Mistral Small 3.1 leads

Granite 3.1 8b Instruct: 35.5 (#266), Mistral Small 3.1: 37.0 (#259)

BenchmarkGranite 3.1 8b InstructMistral Small 3.1
LMArena Text11501277
LMArena Creative Writing11291253
LMArena Multi-Turn11081270
EQ-Bench Creative Writing—761
WildBench—78.8%

Frequently asked questions

Is Granite 3.1 8b Instruct better than Mistral Small 3.1?

Granite 3.1 8b Instruct and Mistral Small 3.1 score almost the same on the Noometry Index (32.4 vs 31.7), so choose on price, context window or the category you care about most.

Is Granite 3.1 8b Instruct or Mistral Small 3.1 better for coding?

Mistral Small 3.1 scores higher on coding benchmarks: 38.3 versus 34.5 in the Noometry coding category.

How many benchmarks do Granite 3.1 8b Instruct and Mistral Small 3.1 share?

12 benchmarks have published results for both models. Granite 3.1 8b Instruct has 13 scored results on Noometry and Mistral Small 3.1 has 28.

Related comparisons

Go deeper