Model comparison
Falcon-180B vs Mistral Small 3.1
Falcon-180B and Mistral Small 3.1 score almost the same on the Noometry Index (32.2 vs 31.7), so choose on price, context window or the category you care about most.
Last verified . 7 shared benchmarks.
Technology Innovation Institute
Mistral AISummary
- They share 7 benchmarks with published results for both. Falcon-180B scores higher in 0 categories and Mistral Small 3.1 in 4 categories; 3 gaps are clear of the uncertainty.
- The widest gap is in multilingual, where Mistral Small 3.1 leads 41.2 to 25.2.
Side by side
| Falcon-180B | Mistral Small 3.1 | |
|---|---|---|
| Provider | Technology Innovation Institute | Mistral AI |
| Noometry Index | 32.2 | 31.7 |
| Released | 2023-09-06 | 2025-03-17 |
| Weights | Open | Open |
| Context window | — | 128K |
| Max output | — | 102K |
| Input $ / M tokens | — | $0.35 |
| Output $ / M tokens | — | $0.56 |
| Results tracked | 16 | 28 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Not comparable
Falcon-180B: —, Mistral Small 3.1: 38.3 (#179)
| Benchmark | Falcon-180B | Mistral Small 3.1 |
|---|---|---|
| LMArena Coding | — | 1309 |
Reasoning Too close to call
Falcon-180B: 19.1 (#269), Mistral Small 3.1: 19.7 (#254)
| Benchmark | Falcon-180B | Mistral Small 3.1 |
|---|---|---|
| LMArena Hard Prompts | 1007 | 1278 |
| Epoch Capabilities Index | 112.13 | 127.48 |
| Chess Puzzles | — | 1% |
| HellaSwag | 89% | — |
| LAMBADA | 79.8% | — |
| PIQA | 84.9% | — |
| WinoGrande | 87.1% | — |
Math Not comparable
Falcon-180B: —, Mistral Small 3.1: 14.7 (#301)
| Benchmark | Falcon-180B | Mistral Small 3.1 |
|---|---|---|
| OTIS Mock AIME 2024-2025 | — | 3.9% |
| Omni-MATH | — | 24.8% |
| LMArena Math | — | 1262 |
| GSM8K | 54.4% | — |
Knowledge Not comparable
Falcon-180B: —, Mistral Small 3.1: 22.6 (#271)
| Benchmark | Falcon-180B | Mistral Small 3.1 |
|---|---|---|
| GPQA Diamond | — | 41.9% |
| MMLU-Pro | — | 61% |
| GPQA (HELM) | — | 39.2% |
| LMArena Expert | — | 1257 |
| ARC (AI2) Challenge | 67.8% | — |
| BoolQ | 89% | — |
| MMLU | 70.6% | — |
| OpenBookQA | 64.2% | — |
Multimodal Not comparable
Falcon-180B: —, Mistral Small 3.1: 33.2 (#99)
| Benchmark | Falcon-180B | Mistral Small 3.1 |
|---|---|---|
| LMArena Vision | — | 1136 |
Multilingual Mistral Small 3.1 leads
Falcon-180B: 25.2 (#286), Mistral Small 3.1: 41.2 (#209)
| Benchmark | Falcon-180B | Mistral Small 3.1 |
|---|---|---|
| LMArena Non-English | 1000 | 1255 |
| LMArena Chinese | — | 1253 |
| LMArena French | — | 1273 |
| LMArena German | — | 1266 |
| LMArena Japanese | — | 1208 |
| LMArena Korean | — | 1206 |
| LMArena Russian | — | 1263 |
| LMArena Spanish | — | 1283 |
Instruction Following Mistral Small 3.1 leads
Falcon-180B: 53.4 (#286), Mistral Small 3.1: 63.6 (#230)
| Benchmark | Falcon-180B | Mistral Small 3.1 |
|---|---|---|
| LMArena Instruction Following | 1047 | 1264 |
| IFEval | — | 75% |
Long Context Not comparable
Falcon-180B: —, Mistral Small 3.1: 39.5 (#178)
| Benchmark | Falcon-180B | Mistral Small 3.1 |
|---|---|---|
| LMArena Longer Query | — | 1299 |
Writing & Preference Mistral Small 3.1 leads
Falcon-180B: 29.1 (#295), Mistral Small 3.1: 37.0 (#259)
| Benchmark | Falcon-180B | Mistral Small 3.1 |
|---|---|---|
| LMArena Text | 1054 | 1277 |
| LMArena Creative Writing | 1089 | 1253 |
| LMArena Multi-Turn | 1013 | 1270 |
| EQ-Bench Creative Writing | — | 761 |
| WildBench | — | 78.8% |
Frequently asked questions
Is Falcon-180B better than Mistral Small 3.1?
Falcon-180B and Mistral Small 3.1 score almost the same on the Noometry Index (32.2 vs 31.7), so choose on price, context window or the category you care about most.
How many benchmarks do Falcon-180B and Mistral Small 3.1 share?
7 benchmarks have published results for both models. Falcon-180B has 16 scored results on Noometry and Mistral Small 3.1 has 28.