Model comparison
Ministral 8B vs Mistral
Mistral is the stronger model overall, scoring 29.9 to 28.2 on the Noometry Index.
Last verified . 12 shared benchmarks.
Mistral AISummary
- They share 12 benchmarks with published results for both. Ministral 8B scores higher in 6 categories and Mistral in 2 categories; 8 gaps are clear of the uncertainty.
- The widest gap is in instruction following, where Ministral 8B leads 60.5 to 52.6.
- Ministral 8B has downloadable open weights; the other is API-only.
Side by side
| Ministral 8B | Mistral | |
|---|---|---|
| Provider | Mistral AI | Mistral AI |
| Noometry Index | 28.2 | 29.9 |
| Released | 2024-10-01 | — |
| Weights | Open | Proprietary |
| Context window | 262K | — |
| Max output | 262K | — |
| Input $ / M tokens | $0.15 | — |
| Output $ / M tokens | $0.15 | — |
| Results tracked | 17 | 22 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Ministral 8B leads
Ministral 8B: 35.0 (#230), Mistral: 33.8 (#250)
| Benchmark | Ministral 8B | Mistral |
|---|---|---|
| LMArena Coding | 1202 | 1162 |
Agentic & Tool Use Not comparable
Ministral 8B: 16.4 (#148), Mistral: —
| Benchmark | Ministral 8B | Mistral |
|---|---|---|
| Berkeley Function Calling Leaderboard | 11.1% | — |
Reasoning Mistral leads
Ministral 8B: 18.4 (#281), Mistral: 22.2 (#200)
| Benchmark | Ministral 8B | Mistral |
|---|---|---|
| LMArena Hard Prompts | 1191 | 1149 |
| DTBench | 45.7% | — |
Math Ministral 8B leads
Ministral 8B: 25.7 (#267), Mistral: 22.3 (#278)
| Benchmark | Ministral 8B | Mistral |
|---|---|---|
| LMArena Math | 1188 | 1180 |
| Omni-MATH | — | 7.2% |
| MATH Level 5 | 14.9% | — |
Knowledge Mistral leads
Ministral 8B: 12.6 (#297), Mistral: 16.6 (#288)
| Benchmark | Ministral 8B | Mistral |
|---|---|---|
| LMArena Expert | 1170 | 1125 |
| GPQA Diamond | 27.1% | — |
| MMLU-Pro | — | 27.7% |
| Vectara Hallucination Rate | 7.4% | — |
| GPQA (HELM) | — | 30.3% |
Multilingual Ministral 8B leads
Ministral 8B: 35.1 (#247), Mistral: 32.8 (#254)
| Benchmark | Ministral 8B | Mistral |
|---|---|---|
| LMArena Non-English | 1165 | 1129 |
| LMArena Chinese | 1193 | 1109 |
| LMArena Russian | 1195 | 1168 |
| LMArena French | — | 1180 |
| LMArena German | — | 1155 |
| LMArena Japanese | — | 1013 |
| LMArena Korean | — | 1032 |
| LMArena Spanish | — | 1143 |
Instruction Following Ministral 8B leads
Ministral 8B: 60.5 (#250), Mistral: 52.6 (#288)
| Benchmark | Ministral 8B | Mistral |
|---|---|---|
| LMArena Instruction Following | 1161 | 1152 |
| IFEval | — | 56.8% |
Long Context Ministral 8B leads
Ministral 8B: 36.7 (#227), Mistral: 35.0 (#245)
| Benchmark | Ministral 8B | Mistral |
|---|---|---|
| LMArena Longer Query | 1212 | 1153 |
Writing & Preference Ministral 8B leads
Ministral 8B: 39.6 (#246), Mistral: 37.0 (#260)
| Benchmark | Ministral 8B | Mistral |
|---|---|---|
| LMArena Text | 1191 | 1165 |
| LMArena Creative Writing | 1175 | 1158 |
| LMArena Multi-Turn | 1166 | 1147 |
| WildBench | — | 66% |
Frequently asked questions
Is Ministral 8B better than Mistral?
Mistral is the stronger model overall, scoring 29.9 to 28.2 on the Noometry Index.
Is Ministral 8B or Mistral better for coding?
Ministral 8B scores higher on coding benchmarks: 35.0 versus 33.8 in the Noometry coding category.
How many benchmarks do Ministral 8B and Mistral share?
12 benchmarks have published results for both models. Ministral 8B has 17 scored results on Noometry and Mistral has 22.