Model comparison

DeepSeek-V2.5 (Sep 2024) vs Kimi K2 Thinking Turbo

Kimi K2 Thinking Turbo is the stronger model overall, scoring 45.4 to 37.0 on the Noometry Index.

Last verified . 17 shared benchmarks.

DeepSeek-V2.5 (Sep 2024) DeepSeek

37.0

Rank #197 Confirmed

Kimi K2 Thinking Turbo Moonshot AI

45.4

Rank #63 Confirmed

Summary

  • They share 17 benchmarks with published results for both. DeepSeek-V2.5 (Sep 2024) scores higher in 0 categories and Kimi K2 Thinking Turbo in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Kimi K2 Thinking Turbo leads 50.9 to 34.2.

Side by side

DeepSeek-V2.5 (Sep 2024) and Kimi K2 Thinking Turbo specifications
DeepSeek-V2.5 (Sep 2024)Kimi K2 Thinking Turbo
ProviderDeepSeekMoonshot AI
Noometry Index37.045.4
Released2024-09-062025-11-06
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2221

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2 Thinking Turbo leads

DeepSeek-V2.5 (Sep 2024): 31.3 (#274), Kimi K2 Thinking Turbo: 38.1 (#166)

Coding benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Kimi K2 Thinking Turbo
LMArena Coding13101454
Aider Polyglot17.8%—
LMArena WebDev—1322
BigCodeBench Instruct48.6%—
BigCodeBench Complete53.2%—
HumanEval+83.5%—
MBPP+74.1%—

Reasoning Kimi K2 Thinking Turbo leads

DeepSeek-V2.5 (Sep 2024): 24.5 (#145), Kimi K2 Thinking Turbo: 31.4 (#72)

Reasoning benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Kimi K2 Thinking Turbo
LMArena Hard Prompts12891428
Chess Puzzles—20%

Math Kimi K2 Thinking Turbo leads

DeepSeek-V2.5 (Sep 2024): 33.3 (#177), Kimi K2 Thinking Turbo: 45.5 (#62)

Math benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Kimi K2 Thinking Turbo
LMArena Math12891429
OTIS Mock AIME 2024-2025—83.1%

Knowledge Kimi K2 Thinking Turbo leads

DeepSeek-V2.5 (Sep 2024): 34.2 (#190), Kimi K2 Thinking Turbo: 50.9 (#64)

Knowledge benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Kimi K2 Thinking Turbo
LMArena Expert12661439
GPQA Diamond—84.2%

Multilingual Kimi K2 Thinking Turbo leads

DeepSeek-V2.5 (Sep 2024): 42.7 (#188), Kimi K2 Thinking Turbo: 51.6 (#104)

Multilingual benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Kimi K2 Thinking Turbo
LMArena Non-English12731398
LMArena Chinese13171457
LMArena French12881425
LMArena German12581390
LMArena Japanese12281356
LMArena Korean12091329
LMArena Russian12891390
LMArena Spanish12481407

Instruction Following Kimi K2 Thinking Turbo leads

DeepSeek-V2.5 (Sep 2024): 67.7 (#189), Kimi K2 Thinking Turbo: 74.2 (#103)

Instruction Following benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Kimi K2 Thinking Turbo
LMArena Instruction Following12801403

Long Context Kimi K2 Thinking Turbo leads

DeepSeek-V2.5 (Sep 2024): 39.5 (#169), Kimi K2 Thinking Turbo: 43.2 (#99)

Long Context benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Kimi K2 Thinking Turbo
LMArena Longer Query13011415

Writing & Preference Kimi K2 Thinking Turbo leads

DeepSeek-V2.5 (Sep 2024): 50.0 (#182), Kimi K2 Thinking Turbo: 60.2 (#99)

Writing & Preference benchmarks
BenchmarkDeepSeek-V2.5 (Sep 2024)Kimi K2 Thinking Turbo
LMArena Text12941415
LMArena Creative Writing12851373
LMArena Multi-Turn12971414

Frequently asked questions

Is DeepSeek-V2.5 (Sep 2024) better than Kimi K2 Thinking Turbo?

Kimi K2 Thinking Turbo is the stronger model overall, scoring 45.4 to 37.0 on the Noometry Index.

Is DeepSeek-V2.5 (Sep 2024) or Kimi K2 Thinking Turbo better for coding?

Kimi K2 Thinking Turbo scores higher on coding benchmarks: 38.1 versus 31.3 in the Noometry coding category.

How many benchmarks do DeepSeek-V2.5 (Sep 2024) and Kimi K2 Thinking Turbo share?

17 benchmarks have published results for both models. DeepSeek-V2.5 (Sep 2024) has 22 scored results on Noometry and Kimi K2 Thinking Turbo has 21.

Related comparisons

Go deeper