Noometry

Model comparison

Kimi K2.5 Instant vs Mistral Small

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 33.4 on the Noometry Index.

Last verified . 17 shared benchmarks.

Kimi K2.5 Instant Moonshot AI

43.6

Rank #89 Confirmed

Mistral Small Mistral AI

33.4

Rank #243 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Kimi K2.5 Instant scores higher in 9 categories and Mistral Small in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Kimi K2.5 Instant leads 39.4 to 16.4.

Side by side

Kimi K2.5 InstantMistral Small
ProviderMoonshot AIMistral AI
Noometry Index43.633.4
Released—2024-02-26
WeightsOpenOpen
Context window—262K
Max output—256K
Input $ / M tokens—$0.15
Output $ / M tokens—$0.60
Results tracked1839

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.5 Instant leads

Kimi K2.5 Instant: 42.6 (#97), Mistral Small: 34.0 (#247)

BenchmarkKimi K2.5 InstantMistral Small
LMArena Coding14841362
LMArena WebDev1404—
SciCode—26.5%
BigCodeBench Instruct—36.1%
LiveBench Coding—36.2%
BigCodeBench Complete—46.6%
ALE-Bench—497.62

Agentic & Tool Use Not comparable

Kimi K2.5 Instant: —, Mistral Small: 28.1 (#93)

BenchmarkKimi K2.5 InstantMistral Small
Berkeley Function Calling Leaderboard—37.1%

Reasoning Kimi K2.5 Instant leads

Kimi K2.5 Instant: 29.7 (#90), Mistral Small: 19.8 (#250)

BenchmarkKimi K2.5 InstantMistral Small
LMArena Hard Prompts14431335
Kagi LLM Benchmark—37.8%
CritPt—0%
LiveBench Reasoning—44.8%
DTBench—70.9%
LiveBench Data Analysis—53.7%
LMCA—20.6%
LiveBench—44%

Math Kimi K2.5 Instant leads

Kimi K2.5 Instant: 39.4 (#105), Mistral Small: 16.4 (#293)

BenchmarkKimi K2.5 InstantMistral Small
LMArena Math14421341
OTIS Mock AIME 2024-2025—5.8%
LiveBench Math—39.9%
MATH Level 5—46.8%

Knowledge Kimi K2.5 Instant leads

Kimi K2.5 Instant: 40.2 (#123), Mistral Small: 31.0 (#222)

BenchmarkKimi K2.5 InstantMistral Small
LMArena Expert14401291
GPQA Diamond—47.5%
Vectara Hallucination Rate—5.1%
MMLU—68.7%

Multimodal Kimi K2.5 Instant leads

Kimi K2.5 Instant: 40.2 (#50), Mistral Small: 33.5 (#96)

BenchmarkKimi K2.5 InstantMistral Small
LMArena Vision12541142

Multilingual Kimi K2.5 Instant leads

Kimi K2.5 Instant: 52.0 (#94), Mistral Small: 45.5 (#169)

BenchmarkKimi K2.5 InstantMistral Small
LMArena Non-English14061315
LMArena Chinese14491340
LMArena French14031337
LMArena German14131340
LMArena Korean13781259
LMArena Russian14041324
LMArena Spanish14471346
LMArena Japanese—1275

Instruction Following Kimi K2.5 Instant leads

Kimi K2.5 Instant: 75.3 (#65), Mistral Small: 66.4 (#209)

BenchmarkKimi K2.5 InstantMistral Small
LMArena Instruction Following14301310
LiveBench Instruction Following—63.7%

Long Context Kimi K2.5 Instant leads

Kimi K2.5 Instant: 43.9 (#83), Mistral Small: 40.4 (#156)

BenchmarkKimi K2.5 InstantMistral Small
LMArena Longer Query14351327

Writing & Preference Kimi K2.5 Instant leads

Kimi K2.5 Instant: 60.6 (#95), Mistral Small: 52.5 (#171)

BenchmarkKimi K2.5 InstantMistral Small
LMArena Text14201338
LMArena Creative Writing13811305
LMArena Multi-Turn14271344
LiveBench Language—30.5%

Frequently asked questions

Is Kimi K2.5 Instant better than Mistral Small?

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 33.4 on the Noometry Index.

Is Kimi K2.5 Instant or Mistral Small better for coding?

Kimi K2.5 Instant scores higher on coding benchmarks: 42.6 versus 34.0 in the Noometry coding category.

How many benchmarks do Kimi K2.5 Instant and Mistral Small share?

17 benchmarks have published results for both models. Kimi K2.5 Instant has 18 scored results on Noometry and Mistral Small has 39.

Related comparisons

Go deeper