Model comparison

Command R+ vs Sonar

Sonar is the stronger model overall, scoring 38.5 to 32.4 on the Noometry Index.

Last verified . 7 shared benchmarks.

Command R+ Cohere

32.4

Rank #257 Confirmed

Sonar Perplexity

38.5

Rank #187 Confirmed

Summary

  • They share 7 benchmarks with published results for both. Command R+ scores higher in 0 categories and Sonar in 5 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Sonar leads 21.1 to 9.2.
  • The biggest single-benchmark swing is LiveBench Reasoning: 24.8% for Command R+ and 46.3% for Sonar.
  • Sonar is cheaper at $1 / $1 per million input/output tokens, against $2.50 / $10 for Command R+.
  • Command R+ has downloadable open weights; the other is API-only.

Side by side

Command R+ and Sonar specifications
Command R+Sonar
ProviderCoherePerplexity
Noometry Index32.438.5
Released2024-08-302024-01-01
WeightsOpenProprietary
Context window128K128K
Max output4K4K
Input $ / M tokens$2.50$1
Output $ / M tokens$10$1
Results tracked347

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Sonar leads

Command R+: 29.1 (#309), Sonar: 35.7 (#221)

Coding benchmarks
BenchmarkCommand R+Sonar
LiveBench Coding19.1%35.1%
BigCodeBench Instruct33.8%—
LMArena Coding1187—
BigCodeBench Complete41.9%—
HumanEval+56.7%—
MBPP+63.5%—

Reasoning Sonar leads

Command R+: 9.2 (#344), Sonar: 21.1 (#227)

Reasoning benchmarks
BenchmarkCommand R+Sonar
LiveBench Reasoning24.8%46.3%
LiveBench Data Analysis38.1%37.9%
LiveBench31.8%46.9%
SimpleBench17.4%—
LMArena Hard Prompts1186—
DTBench54.9%—
LMCA5%—
Epoch Capabilities Index119.34—

Math Sonar leads

Command R+: 28.9 (#242), Sonar: 33.7 (#200)

Math benchmarks
BenchmarkCommand R+Sonar
LiveBench Math21.3%41.6%
LMArena Math1188—

Knowledge Not comparable

Command R+: 36.4 (#169), Sonar: —

Knowledge benchmarks
BenchmarkCommand R+Sonar
Vectara Hallucination Rate6.9%—
LMArena Expert1174—
MMLU69.4%—

Multilingual Not comparable

Command R+: 38.6 (#227), Sonar: —

Multilingual benchmarks
BenchmarkCommand R+Sonar
LMArena Non-English1216—
LMArena Chinese1226—
LMArena French1209—
LMArena German1216—
LMArena Japanese1166—
LMArena Korean1138—
LMArena Russian1227—
LMArena Spanish1189—

Instruction Following Sonar leads

Command R+: 60.0 (#254), Sonar: 71.4 (#150)

Instruction Following benchmarks
BenchmarkCommand R+Sonar
LiveBench Instruction Following57.6%76.2%
LMArena Instruction Following1197—

Long Context Not comparable

Command R+: 37.3 (#219), Sonar: —

Long Context benchmarks
BenchmarkCommand R+Sonar
LMArena Longer Query1230—

Writing & Preference Sonar leads

Command R+: 43.5 (#228), Sonar: 52.6 (#167)

Writing & Preference benchmarks
BenchmarkCommand R+Sonar
LiveBench Language29.7%44.1%
LMArena Text1229—
LMArena Creative Writing1235—
LMArena Multi-Turn1213—

Frequently asked questions

Is Command R+ better than Sonar?

Sonar is the stronger model overall, scoring 38.5 to 32.4 on the Noometry Index.

Which is cheaper, Command R+ or Sonar?

Sonar is cheaper. It lists at $1 per million input tokens and $1 per million output tokens; Command R+ lists at $2.50 and $10.

Is Command R+ or Sonar better for coding?

Sonar scores higher on coding benchmarks: 35.7 versus 29.1 in the Noometry coding category.

Which has the bigger context window?

Both accept 128K tokens.

How many benchmarks do Command R+ and Sonar share?

7 benchmarks have published results for both models. Command R+ has 34 scored results on Noometry and Sonar has 7.

Related comparisons

Go deeper