Model comparison

Mistral Small 3.2 vs Yi-Lightning

Yi-Lightning is the stronger model overall, scoring 36.5 to 30.8 on the Noometry Index.

Last verified . 0 shared benchmarks.

Mistral Small 3.2 Mistral AI

30.8

Rank #271 Confirmed

Yi-Lightning 01.AI

36.5

Rank #206 Confirmed

Summary

  • The widest gap is in math, where Yi-Lightning leads 33.5 to 24.9.
  • Mistral Small 3.2 has downloadable open weights; the other is API-only.

Side by side

Mistral Small 3.2 and Yi-Lightning specifications
Mistral Small 3.2Yi-Lightning
ProviderMistral AI01.AI
Noometry Index30.836.5
Released2025-06-202024-12-02
WeightsOpenProprietary
Context window256K—
Max output16K—
Input $ / M tokens$0.0938—
Output $ / M tokens$0.25—
Results tracked618

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Small 3.2: —, Yi-Lightning: 27.0 (#315)

Coding benchmarks
BenchmarkMistral Small 3.2Yi-Lightning
Aider Polyglot—12.9%
LMArena Coding—1313

Reasoning Yi-Lightning leads

Mistral Small 3.2: 17.5 (#282), Yi-Lightning: 24.9 (#137)

Reasoning benchmarks
BenchmarkMistral Small 3.2Yi-Lightning
Kagi LLM Benchmark40.4%—
Chess Puzzles1%—
LMArena Hard Prompts—1302
Epoch Capabilities Index131.73—

Math Yi-Lightning leads

Mistral Small 3.2: 24.9 (#251), Yi-Lightning: 33.5 (#173)

Math benchmarks
BenchmarkMistral Small 3.2Yi-Lightning
OTIS Mock AIME 2024-202530.3%—
LMArena Math—1300

Knowledge Yi-Lightning leads

Mistral Small 3.2: 26.8 (#249), Yi-Lightning: 34.8 (#182)

Knowledge benchmarks
BenchmarkMistral Small 3.2Yi-Lightning
GPQA Diamond49.1%—
LMArena Expert—1286

Multilingual Not comparable

Mistral Small 3.2: —, Yi-Lightning: 42.4 (#191)

Multilingual benchmarks
BenchmarkMistral Small 3.2Yi-Lightning
LMArena Non-English—1269
LMArena Chinese—1320
LMArena French—1304
LMArena German—1267
LMArena Japanese—1228
LMArena Korean—1192
LMArena Russian—1255
LMArena Spanish—1315

Instruction Following Not comparable

Mistral Small 3.2: —, Yi-Lightning: 67.6 (#191)

Instruction Following benchmarks
BenchmarkMistral Small 3.2Yi-Lightning
LMArena Instruction Following—1278

Long Context Not comparable

Mistral Small 3.2: —, Yi-Lightning: 39.4 (#176)

Long Context benchmarks
BenchmarkMistral Small 3.2Yi-Lightning
LMArena Longer Query—1297

Writing & Preference Yi-Lightning leads

Mistral Small 3.2: 45.1 (#219), Yi-Lightning: 50.4 (#178)

Writing & Preference benchmarks
BenchmarkMistral Small 3.2Yi-Lightning
LMArena Text—1302
LMArena Creative Writing—1280
EQ-Bench Creative Writing1255—
LMArena Multi-Turn—1311

Frequently asked questions

Is Mistral Small 3.2 better than Yi-Lightning?

Yi-Lightning is the stronger model overall, scoring 36.5 to 30.8 on the Noometry Index.

How many benchmarks do Mistral Small 3.2 and Yi-Lightning share?

0 benchmarks have published results for both models. Mistral Small 3.2 has 6 scored results on Noometry and Yi-Lightning has 18.

Related comparisons

Go deeper