Noometry

Model comparison

Command R+ vs Step 3.5 Flash

Step 3.5 Flash is the stronger model overall, scoring 42.3 to 32.4 on the Noometry Index.

Last verified . 17 shared benchmarks.

Command R+ Cohere

32.4

Rank #257 Confirmed

Step 3.5 Flash StepFun

42.3

Rank #116 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Command R+ scores higher in 0 categories and Step 3.5 Flash in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Step 3.5 Flash leads 58.8 to 43.5.
  • Step 3.5 Flash is cheaper at $0.10 / $0.30 per million input/output tokens, against $2.50 / $10 for Command R+.
  • Step 3.5 Flash accepts more context: 256K tokens versus 128K.

Side by side

Command R+Step 3.5 Flash
ProviderCohereStepFun
Noometry Index32.442.3
Released2024-08-302026-01-29
WeightsOpenOpen
Context window128K256K
Max output4K256K
Input $ / M tokens$2.50$0.10
Output $ / M tokens$10$0.30
Results tracked3419

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.5 Flash leads

Command R+: 29.1 (#309), Step 3.5 Flash: 42.4 (#105)

BenchmarkCommand R+Step 3.5 Flash
LMArena Coding11871436
BigCodeBench Instruct33.8%—
LiveBench Coding19.1%—
BigCodeBench Complete41.9%—
HumanEval+56.7%—
MBPP+63.5%—

Reasoning Step 3.5 Flash leads

Command R+: 9.2 (#344), Step 3.5 Flash: 22.2 (#202)

BenchmarkCommand R+Step 3.5 Flash
LMArena Hard Prompts11861411
SimpleBench17.4%—
NYT Connections (extended)—28.4%
LiveBench Reasoning24.8%—
DTBench54.9%—
LiveBench Data Analysis38.1%—
LMCA5%—
Epoch Capabilities Index119.34—
LiveBench31.8%—

Math Step 3.5 Flash leads

Command R+: 28.9 (#242), Step 3.5 Flash: 42.6 (#84)

BenchmarkCommand R+Step 3.5 Flash
LMArena Math11881408
MathArena Final-Answer Competitions—66.8%
LiveBench Math21.3%—

Knowledge Step 3.5 Flash leads

Command R+: 36.4 (#169), Step 3.5 Flash: 39.6 (#132)

BenchmarkCommand R+Step 3.5 Flash
LMArena Expert11741421
Vectara Hallucination Rate6.9%—
MMLU69.4%—

Multilingual Step 3.5 Flash leads

Command R+: 38.6 (#227), Step 3.5 Flash: 50.5 (#119)

BenchmarkCommand R+Step 3.5 Flash
LMArena Non-English12161385
LMArena Chinese12261447
LMArena French12091421
LMArena German12161405
LMArena Japanese11661354
LMArena Korean11381352
LMArena Russian12271385
LMArena Spanish11891419

Instruction Following Step 3.5 Flash leads

Command R+: 60.0 (#254), Step 3.5 Flash: 73.1 (#124)

BenchmarkCommand R+Step 3.5 Flash
LMArena Instruction Following11971385
LiveBench Instruction Following57.6%—

Long Context Step 3.5 Flash leads

Command R+: 37.3 (#219), Step 3.5 Flash: 42.8 (#117)

BenchmarkCommand R+Step 3.5 Flash
LMArena Longer Query12301402

Writing & Preference Step 3.5 Flash leads

Command R+: 43.5 (#228), Step 3.5 Flash: 58.8 (#113)

BenchmarkCommand R+Step 3.5 Flash
LMArena Text12291403
LMArena Creative Writing12351357
LMArena Multi-Turn12131405
LiveBench Language29.7%—

Frequently asked questions

Is Command R+ better than Step 3.5 Flash?

Step 3.5 Flash is the stronger model overall, scoring 42.3 to 32.4 on the Noometry Index.

Which is cheaper, Command R+ or Step 3.5 Flash?

Step 3.5 Flash is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; Command R+ lists at $2.50 and $10.

Is Command R+ or Step 3.5 Flash better for coding?

Step 3.5 Flash scores higher on coding benchmarks: 42.4 versus 29.1 in the Noometry coding category.

Which has the bigger context window?

Step 3.5 Flash does, with 256K tokens against 128K.

How many benchmarks do Command R+ and Step 3.5 Flash share?

17 benchmarks have published results for both models. Command R+ has 34 scored results on Noometry and Step 3.5 Flash has 19.

Related comparisons

Go deeper