Noometry

Model comparison

Command R vs Command R+

Command R and Command R+ score almost the same on the Noometry Index (31.4 vs 32.4), so choose on price, context window or the category you care about most.

Last verified . 29 shared benchmarks.

Command R Cohere

31.4

Rank #272 Confirmed

Command R+ Cohere

32.4

Rank #257 Confirmed

Summary

  • They share 29 benchmarks with published results for both. Command R scores higher in 2 categories and Command R+ in 6 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Command R+ leads 36.4 to 31.0.
  • The biggest single-benchmark swing is LiveBench Language: 16.7% for Command R and 29.7% for Command R+.
  • Command R is cheaper at $0.15 / $0.60 per million input/output tokens, against $2.50 / $10 for Command R+.

Side by side

Command RCommand R+
ProviderCohereCohere
Noometry Index31.432.4
Released2024-08-302024-08-30
WeightsOpenOpen
Context window128K128K
Max output4K4K
Input $ / M tokens$0.15$2.50
Output $ / M tokens$0.60$10
Results tracked2934

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Command R: 29.3 (#306), Command R+: 29.1 (#309)

BenchmarkCommand RCommand R+
BigCodeBench Instruct37.1%33.8%
LiveBench Coding17.9%19.1%
LMArena Coding11691187
BigCodeBench Complete45.2%41.9%
HumanEval+—56.7%
MBPP+—63.5%

Reasoning Command R leads

Command R: 13.8 (#331), Command R+: 9.2 (#344)

BenchmarkCommand RCommand R+
LiveBench Reasoning21.9%24.8%
LMArena Hard Prompts11641186
DTBench46.4%54.9%
LiveBench Data Analysis33.3%38.1%
LMCA9.2%5%
LiveBench27.5%31.8%
SimpleBench—17.4%
Epoch Capabilities Index—119.34

Math Too close to call

Command R: 28.0 (#246), Command R+: 28.9 (#242)

BenchmarkCommand RCommand R+
LiveBench Math19.4%21.3%
LMArena Math11551188

Knowledge Command R+ leads

Command R: 31.0 (#221), Command R+: 36.4 (#169)

BenchmarkCommand RCommand R+
LMArena Expert11381174
MMLU65.2%69.4%
Vectara Hallucination Rate—6.9%

Multilingual Command R+ leads

Command R: 35.7 (#245), Command R+: 38.6 (#227)

BenchmarkCommand RCommand R+
LMArena Non-English11741216
LMArena Chinese11821226
LMArena French11621209
LMArena German11761216
LMArena Japanese11431166
LMArena Korean11631138
LMArena Russian11741227
LMArena Spanish11511189

Instruction Following Command R+ leads

Command R: 58.1 (#261), Command R+: 60.0 (#254)

BenchmarkCommand RCommand R+
LiveBench Instruction Following55.6%57.6%
LMArena Instruction Following11671197

Long Context Command R+ leads

Command R: 36.3 (#231), Command R+: 37.3 (#219)

BenchmarkCommand RCommand R+
LMArena Longer Query11981230

Writing & Preference Command R+ leads

Command R: 38.2 (#254), Command R+: 43.5 (#228)

BenchmarkCommand RCommand R+
LMArena Text11871229
LMArena Creative Writing11701235
LMArena Multi-Turn11631213
LiveBench Language16.7%29.7%

Frequently asked questions

Is Command R better than Command R+?

Command R and Command R+ score almost the same on the Noometry Index (31.4 vs 32.4), so choose on price, context window or the category you care about most.

Which is cheaper, Command R or Command R+?

Command R is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; Command R+ lists at $2.50 and $10.

Is Command R or Command R+ better for coding?

They score almost the same on coding (29.3 vs 29.1); test both on your own repository before choosing.

Which has the bigger context window?

Both accept 128K tokens.

How many benchmarks do Command R and Command R+ share?

29 benchmarks have published results for both models. Command R has 29 scored results on Noometry and Command R+ has 34.

Related comparisons

Go deeper