Model comparison

Kimi K2.5 Instant vs Mistral Nemo

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 26.4 on the Noometry Index.

Last verified . 0 shared benchmarks.

Kimi K2.5 Instant Moonshot AI

43.6

Rank #89 Confirmed

Mistral Nemo Mistral AI

26.4

Rank #337 Confirmed

Summary

  • The widest gap is in writing & preference, where Kimi K2.5 Instant leads 60.6 to 28.5.

Side by side

Kimi K2.5 Instant and Mistral Nemo specifications
Kimi K2.5 InstantMistral Nemo
ProviderMoonshot AIMistral AI
Noometry Index43.626.4
Released—2024-07-01
WeightsOpenOpen
Context window—128K
Max output—128K
Input $ / M tokens—$0.15
Output $ / M tokens—$0.15
Results tracked1810

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Kimi K2.5 Instant: 42.6 (#97), Mistral Nemo: —

Coding benchmarks
BenchmarkKimi K2.5 InstantMistral Nemo
LMArena WebDev1404—
LMArena Coding1484—

Agentic & Tool Use Not comparable

Kimi K2.5 Instant: —, Mistral Nemo: 23.5 (#125)

Agentic & Tool Use benchmarks
BenchmarkKimi K2.5 InstantMistral Nemo
Berkeley Function Calling Leaderboard—27.6%
BALROG—17.6%

Reasoning Kimi K2.5 Instant leads

Kimi K2.5 Instant: 29.7 (#90), Mistral Nemo: 20.7 (#232)

Reasoning benchmarks
BenchmarkKimi K2.5 InstantMistral Nemo
LMArena Hard Prompts1443—
DTBench—48.6%
Epoch Capabilities Index—118.68
PIQA—83.5%

Math Kimi K2.5 Instant leads

Kimi K2.5 Instant: 39.4 (#105), Mistral Nemo: 25.5 (#268)

Math benchmarks
BenchmarkKimi K2.5 InstantMistral Nemo
LMArena Math1442—
MATH Level 5—10.8%
GSM8K—84.2%

Knowledge Kimi K2.5 Instant leads

Kimi K2.5 Instant: 40.2 (#123), Mistral Nemo: 12.3 (#298)

Knowledge benchmarks
BenchmarkKimi K2.5 InstantMistral Nemo
GPQA Diamond—29.9%
LMArena Expert1440—
BoolQ—82.5%

Multimodal Not comparable

Kimi K2.5 Instant: 40.2 (#50), Mistral Nemo: —

Multimodal benchmarks
BenchmarkKimi K2.5 InstantMistral Nemo
LMArena Vision1254—

Multilingual Not comparable

Kimi K2.5 Instant: 52.0 (#94), Mistral Nemo: —

Multilingual benchmarks
BenchmarkKimi K2.5 InstantMistral Nemo
LMArena Non-English1406—
LMArena Chinese1449—
LMArena French1403—
LMArena German1413—
LMArena Korean1378—
LMArena Russian1404—
LMArena Spanish1447—

Instruction Following Not comparable

Kimi K2.5 Instant: 75.3 (#65), Mistral Nemo: —

Instruction Following benchmarks
BenchmarkKimi K2.5 InstantMistral Nemo
LMArena Instruction Following1430—

Long Context Not comparable

Kimi K2.5 Instant: 43.9 (#83), Mistral Nemo: —

Long Context benchmarks
BenchmarkKimi K2.5 InstantMistral Nemo
LMArena Longer Query1435—

Writing & Preference Kimi K2.5 Instant leads

Kimi K2.5 Instant: 60.6 (#95), Mistral Nemo: 28.5 (#296)

Writing & Preference benchmarks
BenchmarkKimi K2.5 InstantMistral Nemo
LMArena Text1420—
LMArena Creative Writing1381—
EQ-Bench Creative Writing—881
LMArena Multi-Turn1427—

Frequently asked questions

Is Kimi K2.5 Instant better than Mistral Nemo?

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 26.4 on the Noometry Index.

How many benchmarks do Kimi K2.5 Instant and Mistral Nemo share?

0 benchmarks have published results for both models. Kimi K2.5 Instant has 18 scored results on Noometry and Mistral Nemo has 10.

Related comparisons

Go deeper