Model comparison

Kimi K3 vs Step 5 Preview

Kimi K3 is the stronger model overall, scoring 59.5 to 47.9 on the Noometry Index. Step 5 Preview costs 4.2× less per token, which makes it the better buy when Kimi K3's lead doesn't matter for your workload.

Last verified . 17 shared benchmarks.

Kimi K3 Moonshot AI

59.5

Rank #15 Confirmed

Step 5 Preview StepFun

47.9

Rank #58 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Kimi K3 scores higher in 8 categories and Step 5 Preview in 1 category; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Kimi K3 leads 74.2 to 46.1.
  • The biggest single-benchmark swing is ProofBench: 87% for Kimi K3 and 42% for Step 5 Preview.
  • Step 5 Preview is cheaper at $1 / $2.70 per million input/output tokens, against $3 / $15 for Kimi K3.
  • Kimi K3 accepts more context: 1.05M tokens versus 1.02M.
  • Kimi K3 has downloadable open weights; the other is API-only.

Side by side

Kimi K3 and Step 5 Preview specifications
Kimi K3Step 5 Preview
ProviderMoonshot AIStepFun
Noometry Index59.547.9
Released2026-07-162026-09-16
WeightsOpenProprietary
Context window1.05M1.02M
Max output1.05M66K
Input $ / M tokens$3$1
Output $ / M tokens$15$2.70
Results tracked5318

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K3 leads

Kimi K3: 61.0 (#10), Step 5 Preview: 51.8 (#36)

Coding benchmarks
BenchmarkKimi K3Step 5 Preview
LMArena WebDev16541564
SciCode59.5%58.9%
LMArena Coding15081480
DeepSWE68.5%—
FrontierCode44.2%—
FrontierSWE25.9%—
WeirdML82.6%—
ALE-Bench1,524—

Agentic & Tool Use Not comparable

Kimi K3: 41.8 (#20), Step 5 Preview: —

Agentic & Tool Use benchmarks
BenchmarkKimi K3Step 5 Preview
APEX-Agents50.6%—
τ²-bench Banking37.1%—
PostTrainBench32%—
GBAEval48.3%—
GDP.pdf19%—
Vending-Bench 25,165—

Reasoning Kimi K3 leads

Kimi K3: 63.0 (#17), Step 5 Preview: 40.0 (#57)

Reasoning benchmarks
BenchmarkKimi K3Step 5 Preview
CritPt23.4%20.9%
LMArena Hard Prompts14961465
ARC-AGI-260.4%—
SimpleBench60.7%—
NYT Connections (extended)93.6%—
ARC-AGI-194.5%—
Chess Puzzles39%—
Mystery Game Puzzles26%—
DTBench91.2%—
LMCA52.7%—
Surface Evolver Bench95%—
Epoch Capabilities Index157.45—
ForecastBench61.1—

Math Kimi K3 leads

Kimi K3: 74.2 (#16), Step 5 Preview: 46.1 (#72)

Math benchmarks
BenchmarkKimi K3Step 5 Preview
ProofBench87%42%
LMArena Math14911470
FrontierMath (Tiers 1-3)72.2%—
FrontierMath Tier 439%—
MathArena Final-Answer Competitions87.8%—
OTIS Mock AIME 2024-202597.2%—

Knowledge Kimi K3 leads

Kimi K3: 63.2 (#21), Step 5 Preview: 41.2 (#112)

Knowledge benchmarks
BenchmarkKimi K3Step 5 Preview
LMArena Expert15211470
GPQA Diamond93.1%—
SimpleQA Verified50.6%—

Multimodal Step 5 Preview leads

Kimi K3: 37.8 (#70), Step 5 Preview: 41.0 (#41)

Multimodal benchmarks
BenchmarkKimi K3Step 5 Preview
LMArena Vision—1267
Blueprint-Bench 229.5%—
Furniture Assembly34.2%—

Multilingual Kimi K3 leads

Kimi K3: 56.3 (#21), Step 5 Preview: 53.8 (#54)

Multilingual benchmarks
BenchmarkKimi K3Step 5 Preview
LMArena Non-English14661432
LMArena Chinese15291519
LMArena Russian14821436
LMArena Spanish14721439
LMArena French1491—
LMArena German1488—
LMArena Japanese1487—
LMArena Korean1458—

Instruction Following Kimi K3 leads

Kimi K3: 77.7 (#14), Step 5 Preview: 76.0 (#50)

Instruction Following benchmarks
BenchmarkKimi K3Step 5 Preview
LMArena Instruction Following14831444

Long Context Kimi K3 leads

Kimi K3: 45.8 (#29), Step 5 Preview: 44.5 (#64)

Long Context benchmarks
BenchmarkKimi K3Step 5 Preview
LMArena Longer Query14941455

Writing & Preference Kimi K3 leads

Kimi K3: 76.6 (#4), Step 5 Preview: 62.8 (#71)

Writing & Preference benchmarks
BenchmarkKimi K3Step 5 Preview
LMArena Text14761442
LMArena Creative Writing14541410
LMArena Multi-Turn14881447
EQ-Bench Creative Writing2082—
EQ-Bench 41339—

Frequently asked questions

Is Kimi K3 better than Step 5 Preview?

Kimi K3 is the stronger model overall, scoring 59.5 to 47.9 on the Noometry Index. Step 5 Preview costs 4.2× less per token, which makes it the better buy when Kimi K3's lead doesn't matter for your workload.

Which is cheaper, Kimi K3 or Step 5 Preview?

Step 5 Preview is cheaper. It lists at $1 per million input tokens and $2.70 per million output tokens; Kimi K3 lists at $3 and $15.

Is Kimi K3 or Step 5 Preview better for coding?

Kimi K3 scores higher on coding benchmarks: 61.0 versus 51.8 in the Noometry coding category.

Which has the bigger context window?

Kimi K3 does, with 1.05M tokens against 1.02M.

How many benchmarks do Kimi K3 and Step 5 Preview share?

17 benchmarks have published results for both models. Kimi K3 has 53 scored results on Noometry and Step 5 Preview has 18.

Related comparisons

Go deeper