Noometry

Model comparison

Command R+ vs Step 1o Turbo 202506

Step 1o Turbo 202506 is the stronger model overall, scoring 39.7 to 32.4 on the Noometry Index.

Last verified . 13 shared benchmarks.

Command R+ Cohere

32.4

Rank #257 Confirmed

Step 1o Turbo 202506 StepFun

39.7

Rank #160 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Command R+ scores higher in 1 category and Step 1o Turbo 202506 in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Step 1o Turbo 202506 leads 26.8 to 9.2.
  • Command R+ has downloadable open weights; the other is API-only.

Side by side

Command R+Step 1o Turbo 202506
ProviderCohereStepFun
Noometry Index32.439.7
Released2024-08-30—
WeightsOpenProprietary
Context window128K—
Max output4K—
Input $ / M tokens$2.50—
Output $ / M tokens$10—
Results tracked3414

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 1o Turbo 202506 leads

Command R+: 29.1 (#309), Step 1o Turbo 202506: 39.2 (#160)

BenchmarkCommand R+Step 1o Turbo 202506
LMArena Coding11871339
BigCodeBench Instruct33.8%—
LiveBench Coding19.1%—
BigCodeBench Complete41.9%—
HumanEval+56.7%—
MBPP+63.5%—

Reasoning Step 1o Turbo 202506 leads

Command R+: 9.2 (#344), Step 1o Turbo 202506: 26.8 (#129)

BenchmarkCommand R+Step 1o Turbo 202506
LMArena Hard Prompts11861335
SimpleBench17.4%—
LiveBench Reasoning24.8%—
DTBench54.9%—
LiveBench Data Analysis38.1%—
LMCA5%—
Epoch Capabilities Index119.34—
LiveBench31.8%—

Math Step 1o Turbo 202506 leads

Command R+: 28.9 (#242), Step 1o Turbo 202506: 36.6 (#164)

BenchmarkCommand R+Step 1o Turbo 202506
LMArena Math11881318
LiveBench Math21.3%—

Knowledge Too close to call

Command R+: 36.4 (#169), Step 1o Turbo 202506: 36.1 (#176)

BenchmarkCommand R+Step 1o Turbo 202506
LMArena Expert11741308
Vectara Hallucination Rate6.9%—
MMLU69.4%—

Multimodal Not comparable

Command R+: —, Step 1o Turbo 202506: 36.1 (#80)

BenchmarkCommand R+Step 1o Turbo 202506
LMArena Vision—1186

Multilingual Step 1o Turbo 202506 leads

Command R+: 38.6 (#227), Step 1o Turbo 202506: 45.3 (#173)

BenchmarkCommand R+Step 1o Turbo 202506
LMArena Non-English12161313
LMArena Chinese12261380
LMArena German12161314
LMArena Russian12271327
LMArena French1209—
LMArena Japanese1166—
LMArena Korean1138—
LMArena Spanish1189—

Instruction Following Step 1o Turbo 202506 leads

Command R+: 60.0 (#254), Step 1o Turbo 202506: 69.2 (#176)

BenchmarkCommand R+Step 1o Turbo 202506
LMArena Instruction Following11971310
LiveBench Instruction Following57.6%—

Long Context Step 1o Turbo 202506 leads

Command R+: 37.3 (#219), Step 1o Turbo 202506: 41.0 (#146)

BenchmarkCommand R+Step 1o Turbo 202506
LMArena Longer Query12301348

Writing & Preference Step 1o Turbo 202506 leads

Command R+: 43.5 (#228), Step 1o Turbo 202506: 53.1 (#160)

BenchmarkCommand R+Step 1o Turbo 202506
LMArena Text12291336
LMArena Creative Writing12351307
LMArena Multi-Turn12131340
LiveBench Language29.7%—

Frequently asked questions

Is Command R+ better than Step 1o Turbo 202506?

Step 1o Turbo 202506 is the stronger model overall, scoring 39.7 to 32.4 on the Noometry Index.

Is Command R+ or Step 1o Turbo 202506 better for coding?

Step 1o Turbo 202506 scores higher on coding benchmarks: 39.2 versus 29.1 in the Noometry coding category.

How many benchmarks do Command R+ and Step 1o Turbo 202506 share?

13 benchmarks have published results for both models. Command R+ has 34 scored results on Noometry and Step 1o Turbo 202506 has 14.

Related comparisons

Go deeper