Model comparison

Kimi K2.5 Instant vs Step 2 16k Exp 202412

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 39.2 on the Noometry Index.

Last verified . 12 shared benchmarks.

Kimi K2.5 Instant Moonshot AI

43.6

Rank #89 Confirmed

Step 2 16k Exp 202412 StepFun

39.2

Rank #171 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Kimi K2.5 Instant scores higher in 8 categories and Step 2 16k Exp 202412 in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Kimi K2.5 Instant leads 60.6 to 52.3.
  • Kimi K2.5 Instant has downloadable open weights; the other is API-only.

Side by side

Kimi K2.5 Instant and Step 2 16k Exp 202412 specifications
Kimi K2.5 InstantStep 2 16k Exp 202412
ProviderMoonshot AIStepFun
Noometry Index43.639.2
Released——
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1812

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.5 Instant leads

Kimi K2.5 Instant: 42.6 (#97), Step 2 16k Exp 202412: 38.5 (#174)

Coding benchmarks
BenchmarkKimi K2.5 InstantStep 2 16k Exp 202412
LMArena Coding14841316
LMArena WebDev1404—

Reasoning Kimi K2.5 Instant leads

Kimi K2.5 Instant: 29.7 (#90), Step 2 16k Exp 202412: 25.9 (#142)

Reasoning benchmarks
BenchmarkKimi K2.5 InstantStep 2 16k Exp 202412
LMArena Hard Prompts14431299

Math Kimi K2.5 Instant leads

Kimi K2.5 Instant: 39.4 (#105), Step 2 16k Exp 202412: 36.3 (#169)

Math benchmarks
BenchmarkKimi K2.5 InstantStep 2 16k Exp 202412
LMArena Math14421304

Knowledge Kimi K2.5 Instant leads

Kimi K2.5 Instant: 40.2 (#123), Step 2 16k Exp 202412: 35.2 (#187)

Knowledge benchmarks
BenchmarkKimi K2.5 InstantStep 2 16k Exp 202412
LMArena Expert14401279

Multimodal Not comparable

Kimi K2.5 Instant: 40.2 (#50), Step 2 16k Exp 202412: —

Multimodal benchmarks
BenchmarkKimi K2.5 InstantStep 2 16k Exp 202412
LMArena Vision1254—

Multilingual Kimi K2.5 Instant leads

Kimi K2.5 Instant: 52.0 (#94), Step 2 16k Exp 202412: 43.7 (#181)

Multilingual benchmarks
BenchmarkKimi K2.5 InstantStep 2 16k Exp 202412
LMArena Non-English14061290
LMArena Chinese14491331
LMArena Russian14041324
LMArena French1403—
LMArena German1413—
LMArena Korean1378—
LMArena Spanish1447—

Instruction Following Kimi K2.5 Instant leads

Kimi K2.5 Instant: 75.3 (#65), Step 2 16k Exp 202412: 67.9 (#192)

Instruction Following benchmarks
BenchmarkKimi K2.5 InstantStep 2 16k Exp 202412
LMArena Instruction Following14301287

Long Context Kimi K2.5 Instant leads

Kimi K2.5 Instant: 43.9 (#83), Step 2 16k Exp 202412: 39.7 (#170)

Long Context benchmarks
BenchmarkKimi K2.5 InstantStep 2 16k Exp 202412
LMArena Longer Query14351307

Writing & Preference Kimi K2.5 Instant leads

Kimi K2.5 Instant: 60.6 (#95), Step 2 16k Exp 202412: 52.3 (#173)

Writing & Preference benchmarks
BenchmarkKimi K2.5 InstantStep 2 16k Exp 202412
LMArena Text14201321
LMArena Creative Writing13811328
LMArena Multi-Turn14271292

Frequently asked questions

Is Kimi K2.5 Instant better than Step 2 16k Exp 202412?

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 39.2 on the Noometry Index.

Is Kimi K2.5 Instant or Step 2 16k Exp 202412 better for coding?

Kimi K2.5 Instant scores higher on coding benchmarks: 42.6 versus 38.5 in the Noometry coding category.

How many benchmarks do Kimi K2.5 Instant and Step 2 16k Exp 202412 share?

12 benchmarks have published results for both models. Kimi K2.5 Instant has 18 scored results on Noometry and Step 2 16k Exp 202412 has 12.

Related comparisons

Go deeper