# Gemini 1.5 Flash 8B vs Mistral Small

> Mistral Small is the stronger model overall, scoring 33.4 to 29.9 on the Noometry Index.

- Canonical page: https://noometry.com/compare/gemini-1-5-flash-8b-vs-mistral-small
- Last updated: 2026-10-11
- Shared benchmarks: 21

## Summary

- They share 21 benchmarks with published results for both. Gemini 1.5 Flash 8B scores higher in 2 categories and Mistral Small in 7 categories; 8 gaps are clear of the uncertainty.
- The widest gap is in knowledge, where Mistral Small leads 31.0 to 16.0.
- The biggest single-benchmark swing is DTBench: 50% for Gemini 1.5 Flash 8B and 70.9% for Mistral Small.
- Mistral Small has downloadable open weights; the other is API-only.

## Snapshot

| | Gemini 1.5 Flash 8B | Mistral Small |
|---|---|---|
| Provider | Google | Mistral AI |
| Noometry Index | 29.9 | 33.4 |
| Rank | 301 | 243 |
| Context | — | 262K |
| Input $/M | — | $0.15 |
| Output $/M | — | $0.60 |
| Weights | Proprietary | Open |

## Coding

- Gemini 1.5 Flash 8B: 35.5 (#225)
- Mistral Small: 34.0 (#247)

| Benchmark | Gemini 1.5 Flash 8B | Mistral Small |
|---|---|---|
| LMArena Coding | 1218 | 1362 |
| SciCode | — | 26.5% |
| BigCodeBench Instruct | — | 36.1% |
| LiveBench Coding | — | 36.2% |
| BigCodeBench Complete | — | 46.6% |
| ALE-Bench | — | 497.62 |

## Agentic & Tool Use

- Gemini 1.5 Flash 8B: —
- Mistral Small: 28.1 (#93)

| Benchmark | Gemini 1.5 Flash 8B | Mistral Small |
|---|---|---|
| Berkeley Function Calling Leaderboard | — | 37.1% |

## Reasoning

- Gemini 1.5 Flash 8B: 20.0 (#244)
- Mistral Small: 19.8 (#250)

| Benchmark | Gemini 1.5 Flash 8B | Mistral Small |
|---|---|---|
| LMArena Hard Prompts | 1209 | 1335 |
| DTBench | 50% | 70.9% |
| Kagi LLM Benchmark | — | 37.8% |
| CritPt | — | 0% |
| LiveBench Reasoning | — | 44.8% |
| LiveBench Data Analysis | — | 53.7% |
| LMCA | — | 20.6% |
| LiveBench | — | 44% |

## Math

- Gemini 1.5 Flash 8B: 14.2 (#302)
- Mistral Small: 16.4 (#293)

| Benchmark | Gemini 1.5 Flash 8B | Mistral Small |
|---|---|---|
| OTIS Mock AIME 2024-2025 | 4.6% | 5.8% |
| LMArena Math | 1207 | 1341 |
| LiveBench Math | — | 39.9% |
| MATH Level 5 | — | 46.8% |

## Knowledge

- Gemini 1.5 Flash 8B: 16.0 (#289)
- Mistral Small: 31.0 (#222)

| Benchmark | Gemini 1.5 Flash 8B | Mistral Small |
|---|---|---|
| GPQA Diamond | 33% | 47.5% |
| LMArena Expert | 1185 | 1291 |
| Vectara Hallucination Rate | — | 5.1% |
| MMLU | — | 68.7% |

## Multimodal

- Gemini 1.5 Flash 8B: 28.2 (#115)
- Mistral Small: 33.5 (#96)

| Benchmark | Gemini 1.5 Flash 8B | Mistral Small |
|---|---|---|
| LMArena Vision | 1044 | 1142 |

## Multilingual

- Gemini 1.5 Flash 8B: 38.5 (#229)
- Mistral Small: 45.5 (#169)

| Benchmark | Gemini 1.5 Flash 8B | Mistral Small |
|---|---|---|
| LMArena Non-English | 1215 | 1315 |
| LMArena Chinese | 1231 | 1340 |
| LMArena French | 1234 | 1337 |
| LMArena German | 1206 | 1340 |
| LMArena Japanese | 1150 | 1275 |
| LMArena Korean | 1140 | 1259 |
| LMArena Russian | 1236 | 1324 |
| LMArena Spanish | 1212 | 1346 |

## Instruction Following

- Gemini 1.5 Flash 8B: 62.8 (#236)
- Mistral Small: 66.4 (#209)

| Benchmark | Gemini 1.5 Flash 8B | Mistral Small |
|---|---|---|
| LMArena Instruction Following | 1199 | 1310 |
| LiveBench Instruction Following | — | 63.7% |

## Long Context

- Gemini 1.5 Flash 8B: 37.0 (#225)
- Mistral Small: 40.4 (#156)

| Benchmark | Gemini 1.5 Flash 8B | Mistral Small |
|---|---|---|
| LMArena Longer Query | 1219 | 1327 |

## Writing & Preference

- Gemini 1.5 Flash 8B: 42.8 (#232)
- Mistral Small: 52.5 (#171)

| Benchmark | Gemini 1.5 Flash 8B | Mistral Small |
|---|---|---|
| LMArena Text | 1226 | 1338 |
| LMArena Creative Writing | 1218 | 1305 |
| LMArena Multi-Turn | 1185 | 1344 |
| LiveBench Language | — | 30.5% |

## FAQ

### Is Gemini 1.5 Flash 8B better than Mistral Small?

Mistral Small is the stronger model overall, scoring 33.4 to 29.9 on the Noometry Index.

### Is Gemini 1.5 Flash 8B or Mistral Small better for coding?

Gemini 1.5 Flash 8B scores higher on coding benchmarks: 35.5 versus 34.0 in the Noometry coding category.

### How many benchmarks do Gemini 1.5 Flash 8B and Mistral Small share?

21 benchmarks have published results for both models. Gemini 1.5 Flash 8B has 21 scored results on Noometry and Mistral Small has 39.