# Mistral Medium 3.5 vs Yi-Lightning

> Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 37.1 on the Noometry Index.

- Canonical page: https://noometry.com/compare/mistral-medium-3-5-vs-yi-lightning
- Last updated: 2026-10-12
- Shared benchmarks: 16

## Summary

- They share 16 benchmarks with published results for both. Mistral Medium 3.5 scores higher in 7 categories and Yi-Lightning in 1 category; 8 gaps are clear of the uncertainty.
- The widest gap is in multilingual, where Mistral Medium 3.5 leads 51.9 to 42.2.
- Mistral Medium 3.5 has downloadable open weights; the other is API-only.

## Snapshot

| | Mistral Medium 3.5 | Yi-Lightning |
|---|---|---|
| Provider | Mistral AI | 01.AI |
| Noometry Index | 40.2 | 37.1 |
| Rank | 152 | 209 |
| Context | 262K | — |
| Input $/M | $1.50 | — |
| Output $/M | $7.50 | — |
| Weights | Open | Proprietary |

## Coding

- Mistral Medium 3.5: 36.0 (#213)
- Yi-Lightning: 27.4 (#320)

| Benchmark | Mistral Medium 3.5 | Yi-Lightning |
|---|---|---|
| LMArena Coding | 1461 | 1312 |
| Aider Polyglot | — | 12.9% |
| LMArena WebDev | 1264 | — |

## Reasoning

- Mistral Medium 3.5: 17.3 (#295)
- Yi-Lightning: 25.9 (#139)

| Benchmark | Mistral Medium 3.5 | Yi-Lightning |
|---|---|---|
| LMArena Hard Prompts | 1436 | 1302 |
| Kagi LLM Benchmark | 41.4% | — |
| NYT Connections (extended) | 12.9% | — |
| Epoch Capabilities Index | 141.35 | — |

## Math

- Mistral Medium 3.5: 39.1 (#113)
- Yi-Lightning: 36.2 (#172)

| Benchmark | Mistral Medium 3.5 | Yi-Lightning |
|---|---|---|
| LMArena Math | 1431 | 1300 |

## Knowledge

- Mistral Medium 3.5: 40.0 (#126)
- Yi-Lightning: 35.4 (#185)

| Benchmark | Mistral Medium 3.5 | Yi-Lightning |
|---|---|---|
| LMArena Expert | 1432 | 1286 |

## Multimodal

- Mistral Medium 3.5: 38.3 (#65)
- Yi-Lightning: —

| Benchmark | Mistral Medium 3.5 | Yi-Lightning |
|---|---|---|
| LMArena Vision | 1223 | — |

## Multilingual

- Mistral Medium 3.5: 51.9 (#100)
- Yi-Lightning: 42.2 (#196)

| Benchmark | Mistral Medium 3.5 | Yi-Lightning |
|---|---|---|
| LMArena Non-English | 1404 | 1269 |
| LMArena Chinese | 1442 | 1320 |
| LMArena French | 1448 | 1305 |
| LMArena German | 1451 | 1267 |
| LMArena Korean | 1385 | 1192 |
| LMArena Russian | 1395 | 1255 |
| LMArena Spanish | 1409 | 1315 |
| LMArena Japanese | — | 1228 |

## Instruction Following

- Mistral Medium 3.5: 74.6 (#90)
- Yi-Lightning: 67.4 (#196)

| Benchmark | Mistral Medium 3.5 | Yi-Lightning |
|---|---|---|
| LMArena Instruction Following | 1415 | 1278 |

## Long Context

- Mistral Medium 3.5: 43.2 (#103)
- Yi-Lightning: 39.4 (#181)

| Benchmark | Mistral Medium 3.5 | Yi-Lightning |
|---|---|---|
| LMArena Longer Query | 1415 | 1297 |

## Writing & Preference

- Mistral Medium 3.5: 58.5 (#117)
- Yi-Lightning: 50.2 (#184)

| Benchmark | Mistral Medium 3.5 | Yi-Lightning |
|---|---|---|
| LMArena Text | 1421 | 1302 |
| LMArena Creative Writing | 1374 | 1280 |
| LMArena Multi-Turn | 1423 | 1311 |
| EQ-Bench 4 | 993 | — |

## FAQ

### Is Mistral Medium 3.5 better than Yi-Lightning?

Mistral Medium 3.5 is the stronger model overall, scoring 40.2 to 37.1 on the Noometry Index.

### Is Mistral Medium 3.5 or Yi-Lightning better for coding?

Mistral Medium 3.5 scores higher on coding benchmarks: 36.0 versus 27.4 in the Noometry coding category.

### How many benchmarks do Mistral Medium 3.5 and Yi-Lightning share?

16 benchmarks have published results for both models. Mistral Medium 3.5 has 22 scored results on Noometry and Yi-Lightning has 18.