Noometry

Model comparison

Claude 3 Opus vs Kimi K2 Thinking Turbo

Kimi K2 Thinking Turbo is the stronger model overall, scoring 45.4 to 29.3 on the Noometry Index.

Last verified . 20 shared benchmarks.

Claude 3 Opus Anthropic

29.3

Rank #300 Confirmed

Kimi K2 Thinking Turbo Moonshot AI

45.4

Rank #63 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Claude 3 Opus scores higher in 0 categories and Kimi K2 Thinking Turbo in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Kimi K2 Thinking Turbo leads 45.5 to 13.9.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 4.7% for Claude 3 Opus and 83.1% for Kimi K2 Thinking Turbo.
  • Kimi K2 Thinking Turbo has downloadable open weights; the other is API-only.

Side by side

Claude 3 OpusKimi K2 Thinking Turbo
ProviderAnthropicMoonshot AI
Noometry Index29.345.4
Released2024-02-292025-11-06
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked4621

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2 Thinking Turbo leads

Claude 3 Opus: 32.4 (#261), Kimi K2 Thinking Turbo: 38.1 (#166)

BenchmarkClaude 3 OpusKimi K2 Thinking Turbo
LMArena Coding12641454
LMArena WebDev—1322
WeirdML19.2%—
BigCodeBench Instruct45.5%—
LiveBench Coding38.6%—
BigCodeBench Complete57.4%—
HumanEval+77.4%—
MBPP+73.3%—

Agentic & Tool Use Not comparable

Claude 3 Opus: 24.3 (#110), Kimi K2 Thinking Turbo: —

BenchmarkClaude 3 OpusKimi K2 Thinking Turbo
Cybench10%—
METR Time Horizons29.5%—

Reasoning Kimi K2 Thinking Turbo leads

Claude 3 Opus: 14.2 (#318), Kimi K2 Thinking Turbo: 31.4 (#72)

BenchmarkClaude 3 OpusKimi K2 Thinking Turbo
Chess Puzzles5%20%
LMArena Hard Prompts12461428
SimpleBench23.5%—
EnigmaEval0.8%—
LiveBench Reasoning40.6%—
DTBench61.6%—
LiveBench Data Analysis57.9%—
LMCA17%—
Epoch Capabilities Index126.91—
ForecastBench58.4—
LiveBench49.2%—
WinoGrande88.5%—

Math Kimi K2 Thinking Turbo leads

Claude 3 Opus: 13.9 (#293), Kimi K2 Thinking Turbo: 45.5 (#62)

BenchmarkClaude 3 OpusKimi K2 Thinking Turbo
OTIS Mock AIME 2024-20254.7%83.1%
LMArena Math12731429
LiveBench Math43.6%—
MATH Level 537.5%—

Knowledge Kimi K2 Thinking Turbo leads

Claude 3 Opus: 24.5 (#262), Kimi K2 Thinking Turbo: 50.9 (#64)

BenchmarkClaude 3 OpusKimi K2 Thinking Turbo
GPQA Diamond47.2%84.2%
LMArena Expert12231439
SimpleQA Verified12.6%—
Confabulations22.7%—
MMLU84.6%—

Multimodal Not comparable

Claude 3 Opus: 26.6 (#112), Kimi K2 Thinking Turbo: —

BenchmarkClaude 3 OpusKimi K2 Thinking Turbo
LMArena Vision1023—

Multilingual Kimi K2 Thinking Turbo leads

Claude 3 Opus: 41.6 (#202), Kimi K2 Thinking Turbo: 51.6 (#104)

BenchmarkClaude 3 OpusKimi K2 Thinking Turbo
LMArena Non-English12581398
LMArena Chinese12481457
LMArena French12741425
LMArena German12581390
LMArena Japanese12041356
LMArena Korean11871329
LMArena Russian12801390
LMArena Spanish12461407

Instruction Following Kimi K2 Thinking Turbo leads

Claude 3 Opus: 64.3 (#223), Kimi K2 Thinking Turbo: 74.2 (#103)

BenchmarkClaude 3 OpusKimi K2 Thinking Turbo
LMArena Instruction Following12481403
LiveBench Instruction Following63.9%—

Long Context Kimi K2 Thinking Turbo leads

Claude 3 Opus: 38.2 (#197), Kimi K2 Thinking Turbo: 43.2 (#99)

BenchmarkClaude 3 OpusKimi K2 Thinking Turbo
LMArena Longer Query12591415

Writing & Preference Kimi K2 Thinking Turbo leads

Claude 3 Opus: 47.4 (#208), Kimi K2 Thinking Turbo: 60.2 (#99)

BenchmarkClaude 3 OpusKimi K2 Thinking Turbo
LMArena Text12621415
LMArena Creative Writing12351373
LMArena Multi-Turn12751414
LiveBench Language50.4%—

Frequently asked questions

Is Claude 3 Opus better than Kimi K2 Thinking Turbo?

Kimi K2 Thinking Turbo is the stronger model overall, scoring 45.4 to 29.3 on the Noometry Index.

Is Claude 3 Opus or Kimi K2 Thinking Turbo better for coding?

Kimi K2 Thinking Turbo scores higher on coding benchmarks: 38.1 versus 32.4 in the Noometry coding category.

How many benchmarks do Claude 3 Opus and Kimi K2 Thinking Turbo share?

20 benchmarks have published results for both models. Claude 3 Opus has 46 scored results on Noometry and Kimi K2 Thinking Turbo has 21.

Related comparisons

Go deeper