Model comparison

Command R+ vs Kimi K2.5 Instant

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 32.4 on the Noometry Index.

Last verified . 16 shared benchmarks.

Command R+ Cohere

32.4

Rank #257 Confirmed

Kimi K2.5 Instant Moonshot AI

43.6

Rank #89 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Command R+ scores higher in 0 categories and Kimi K2.5 Instant in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Kimi K2.5 Instant leads 29.7 to 9.2.

Side by side

Command R+ and Kimi K2.5 Instant specifications
Command R+Kimi K2.5 Instant
ProviderCohereMoonshot AI
Noometry Index32.443.6
Released2024-08-30—
WeightsOpenOpen
Context window128K—
Max output4K—
Input $ / M tokens$2.50—
Output $ / M tokens$10—
Results tracked3418

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Kimi K2.5 Instant leads

Command R+: 29.1 (#309), Kimi K2.5 Instant: 42.6 (#97)

Coding benchmarks
BenchmarkCommand R+Kimi K2.5 Instant
LMArena Coding11871484
LMArena WebDev—1404
BigCodeBench Instruct33.8%—
LiveBench Coding19.1%—
BigCodeBench Complete41.9%—
HumanEval+56.7%—
MBPP+63.5%—

Reasoning Kimi K2.5 Instant leads

Command R+: 9.2 (#344), Kimi K2.5 Instant: 29.7 (#90)

Reasoning benchmarks
BenchmarkCommand R+Kimi K2.5 Instant
LMArena Hard Prompts11861443
SimpleBench17.4%—
LiveBench Reasoning24.8%—
DTBench54.9%—
LiveBench Data Analysis38.1%—
LMCA5%—
Epoch Capabilities Index119.34—
LiveBench31.8%—

Math Kimi K2.5 Instant leads

Command R+: 28.9 (#242), Kimi K2.5 Instant: 39.4 (#105)

Math benchmarks
BenchmarkCommand R+Kimi K2.5 Instant
LMArena Math11881442
LiveBench Math21.3%—

Knowledge Kimi K2.5 Instant leads

Command R+: 36.4 (#169), Kimi K2.5 Instant: 40.2 (#123)

Knowledge benchmarks
BenchmarkCommand R+Kimi K2.5 Instant
LMArena Expert11741440
Vectara Hallucination Rate6.9%—
MMLU69.4%—

Multimodal Not comparable

Command R+: —, Kimi K2.5 Instant: 40.2 (#50)

Multimodal benchmarks
BenchmarkCommand R+Kimi K2.5 Instant
LMArena Vision—1254

Multilingual Kimi K2.5 Instant leads

Command R+: 38.6 (#227), Kimi K2.5 Instant: 52.0 (#94)

Multilingual benchmarks
BenchmarkCommand R+Kimi K2.5 Instant
LMArena Non-English12161406
LMArena Chinese12261449
LMArena French12091403
LMArena German12161413
LMArena Korean11381378
LMArena Russian12271404
LMArena Spanish11891447
LMArena Japanese1166—

Instruction Following Kimi K2.5 Instant leads

Command R+: 60.0 (#254), Kimi K2.5 Instant: 75.3 (#65)

Instruction Following benchmarks
BenchmarkCommand R+Kimi K2.5 Instant
LMArena Instruction Following11971430
LiveBench Instruction Following57.6%—

Long Context Kimi K2.5 Instant leads

Command R+: 37.3 (#219), Kimi K2.5 Instant: 43.9 (#83)

Long Context benchmarks
BenchmarkCommand R+Kimi K2.5 Instant
LMArena Longer Query12301435

Writing & Preference Kimi K2.5 Instant leads

Command R+: 43.5 (#228), Kimi K2.5 Instant: 60.6 (#95)

Writing & Preference benchmarks
BenchmarkCommand R+Kimi K2.5 Instant
LMArena Text12291420
LMArena Creative Writing12351381
LMArena Multi-Turn12131427
LiveBench Language29.7%—

Frequently asked questions

Is Command R+ better than Kimi K2.5 Instant?

Kimi K2.5 Instant is the stronger model overall, scoring 43.6 to 32.4 on the Noometry Index.

Is Command R+ or Kimi K2.5 Instant better for coding?

Kimi K2.5 Instant scores higher on coding benchmarks: 42.6 versus 29.1 in the Noometry coding category.

How many benchmarks do Command R+ and Kimi K2.5 Instant share?

16 benchmarks have published results for both models. Command R+ has 34 scored results on Noometry and Kimi K2.5 Instant has 18.

Related comparisons

Go deeper