Model comparison

Kimi K2.5 Instant vs Mistral Small 3.1

Kimi K2.5 Instant is the stronger model overall, scoring 42.9 to 31.4 on the Noometry Index.

Last verified . 17 shared benchmarks.

Kimi K2.5 Instant Moonshot AI

42.9

Rank #92 Confirmed

Mistral Small 3.1 Mistral AI

31.4

Rank #263 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Kimi K2.5 Instant scores higher in 9 categories and Mistral Small 3.1 in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Kimi K2.5 Instant leads 60.8 to 37.2.

Side by side

Kimi K2.5 Instant and Mistral Small 3.1 specifications
Kimi K2.5 InstantMistral Small 3.1
ProviderMoonshot AIMistral AI
Noometry Index42.931.4
Released—2025-03-17
WeightsOpenOpen
Context window—128K
Max output—102K
Input $ / M tokens—$0.35
Output $ / M tokens—$0.56
Results tracked1828

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.5 Instant leads

Kimi K2.5 Instant: 42.3 (#95), Mistral Small 3.1: 37.7 (#175)

Coding benchmarks
BenchmarkKimi K2.5 InstantMistral Small 3.1
LMArena Coding14831309
LMArena WebDev1404—

Reasoning Kimi K2.5 Instant leads

Kimi K2.5 Instant: 28.5 (#88), Mistral Small 3.1: 18.9 (#249)

Reasoning benchmarks
BenchmarkKimi K2.5 InstantMistral Small 3.1
LMArena Hard Prompts14431278
Chess Puzzles—1%
Epoch Capabilities Index—127.48

Math Kimi K2.5 Instant leads

Kimi K2.5 Instant: 36.6 (#105), Mistral Small 3.1: 13.7 (#295)

Math benchmarks
BenchmarkKimi K2.5 InstantMistral Small 3.1
LMArena Math14431261
OTIS Mock AIME 2024-2025—3.9%
Omni-MATH—24.8%

Knowledge Kimi K2.5 Instant leads

Kimi K2.5 Instant: 39.5 (#121), Mistral Small 3.1: 22.6 (#266)

Knowledge benchmarks
BenchmarkKimi K2.5 InstantMistral Small 3.1
LMArena Expert14381258
GPQA Diamond—41.9%
MMLU-Pro—61%
GPQA (HELM)—39.2%

Multimodal Kimi K2.5 Instant leads

Kimi K2.5 Instant: 39.5 (#47), Mistral Small 3.1: 32.6 (#93)

Multimodal benchmarks
BenchmarkKimi K2.5 InstantMistral Small 3.1
LMArena Vision12541136

Multilingual Kimi K2.5 Instant leads

Kimi K2.5 Instant: 52.2 (#89), Mistral Small 3.1: 41.4 (#204)

Multilingual benchmarks
BenchmarkKimi K2.5 InstantMistral Small 3.1
LMArena Non-English14061255
LMArena Chinese14501254
LMArena French14031270
LMArena German14131266
LMArena Korean13781206
LMArena Russian14041263
LMArena Spanish14481283
LMArena Japanese—1210

Instruction Following Kimi K2.5 Instant leads

Kimi K2.5 Instant: 75.5 (#61), Mistral Small 3.1: 63.8 (#225)

Instruction Following benchmarks
BenchmarkKimi K2.5 InstantMistral Small 3.1
LMArena Instruction Following14301264
IFEval—75%

Long Context Kimi K2.5 Instant leads

Kimi K2.5 Instant: 43.8 (#82), Mistral Small 3.1: 39.5 (#172)

Long Context benchmarks
BenchmarkKimi K2.5 InstantMistral Small 3.1
LMArena Longer Query14351300

Writing & Preference Kimi K2.5 Instant leads

Kimi K2.5 Instant: 60.8 (#91), Mistral Small 3.1: 37.2 (#254)

Writing & Preference benchmarks
BenchmarkKimi K2.5 InstantMistral Small 3.1
LMArena Text14201278
LMArena Creative Writing13791253
LMArena Multi-Turn14271270
EQ-Bench Creative Writing—761
WildBench—78.8%

Frequently asked questions

Is Kimi K2.5 Instant better than Mistral Small 3.1?

Kimi K2.5 Instant is the stronger model overall, scoring 42.9 to 31.4 on the Noometry Index.

Is Kimi K2.5 Instant or Mistral Small 3.1 better for coding?

Kimi K2.5 Instant scores higher on coding benchmarks: 42.3 versus 37.7 in the Noometry coding category.

How many benchmarks do Kimi K2.5 Instant and Mistral Small 3.1 share?

17 benchmarks have published results for both models. Kimi K2.5 Instant has 18 scored results on Noometry and Mistral Small 3.1 has 28.

Related comparisons

Go deeper