Model comparison

Claude 2.1 vs Kimi K2.7 Code

Kimi K2.7 Code is the stronger model overall, scoring 43.3 to 25.2 on the Noometry Index.

Last verified . 4 shared benchmarks.

Claude 2.1 Anthropic

25.2

Rank #345 Reported

Kimi K2.7 Code Moonshot AI

43.3

Rank #94 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Claude 2.1 scores higher in 0 categories and Kimi K2.7 Code in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Kimi K2.7 Code leads 52.9 to 10.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.9% for Claude 2.1 and 95.6% for Kimi K2.7 Code.
  • Kimi K2.7 Code has downloadable open weights; the other is API-only.

Side by side

Claude 2.1 and Kimi K2.7 Code specifications
Claude 2.1Kimi K2.7 Code
ProviderAnthropicMoonshot AI
Noometry Index25.243.3
Released2023-11-212026-06-12
WeightsProprietaryOpen
Context window—262K
Max output—262K
Input $ / M tokens—$0.95
Output $ / M tokens—$4
Results tracked719

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.7 Code leads

Claude 2.1: 26.2 (#327), Kimi K2.7 Code: 42.9 (#95)

Coding benchmarks
BenchmarkClaude 2.1Kimi K2.7 Code
WeirdML7.1%54.1%
DeepSWE—30.5%
FrontierCode—30.1%
LMArena WebDev—1473
SciCode—47.5%
ALE-Bench—886.23

Agentic & Tool Use Not comparable

Claude 2.1: —, Kimi K2.7 Code: 24.0 (#122)

Agentic & Tool Use benchmarks
BenchmarkClaude 2.1Kimi K2.7 Code
APEX-Agents—37.6%
GBAEval—0.9%
Vending-Bench 2—5,083

Reasoning Kimi K2.7 Code leads

Claude 2.1: 21.4 (#221), Kimi K2.7 Code: 39.0 (#61)

Reasoning benchmarks
BenchmarkClaude 2.1Kimi K2.7 Code
Epoch Capabilities Index119.27149.97
SimpleBench—57.9%
CritPt—10%
Chess Puzzles—21%
DTBench51%—
Surface Evolver Bench—48.8%
ForecastBench54.2—

Math Kimi K2.7 Code leads

Claude 2.1: 10.2 (#315), Kimi K2.7 Code: 52.9 (#48)

Math benchmarks
BenchmarkClaude 2.1Kimi K2.7 Code
OTIS Mock AIME 2024-20251.9%95.6%
FrontierMath (Tiers 1-3)—54%
FrontierMath Tier 4—12.2%

Knowledge Kimi K2.7 Code leads

Claude 2.1: 15.4 (#292), Kimi K2.7 Code: 53.5 (#57)

Knowledge benchmarks
BenchmarkClaude 2.1Kimi K2.7 Code
GPQA Diamond33%87.9%
SimpleQA Verified—36.5%
MMLU73.5%—

Frequently asked questions

Is Claude 2.1 better than Kimi K2.7 Code?

Kimi K2.7 Code is the stronger model overall, scoring 43.3 to 25.2 on the Noometry Index.

Is Claude 2.1 or Kimi K2.7 Code better for coding?

Kimi K2.7 Code scores higher on coding benchmarks: 42.9 versus 26.2 in the Noometry coding category.

How many benchmarks do Claude 2.1 and Kimi K2.7 Code share?

4 benchmarks have published results for both models. Claude 2.1 has 7 scored results on Noometry and Kimi K2.7 Code has 19.

Related comparisons

Go deeper