Noometry

Model comparison

Command R+ vs Qwen Plus

Qwen Plus is the stronger model overall, scoring 37.1 to 32.4 on the Noometry Index.

Last verified . 15 shared benchmarks.

Command R+ Cohere

32.4

Rank #257 Confirmed

Qwen Plus Alibaba (Qwen)

37.1

Rank #210 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Command R+ scores higher in 2 categories and Qwen Plus in 6 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Qwen Plus leads 28.4 to 9.2.
  • The biggest single-benchmark swing is DTBench: 54.9% for Command R+ and 81.1% for Qwen Plus.
  • Qwen Plus is cheaper at $0.40 / $1.20 per million input/output tokens, against $2.50 / $10 for Command R+.
  • Qwen Plus accepts more context: 1M tokens versus 128K.
  • Command R+ has downloadable open weights; the other is API-only.

Side by side

Command R+Qwen Plus
ProviderCohereAlibaba (Qwen)
Noometry Index32.437.1
Released2024-08-302024-01-25
WeightsOpenProprietary
Context window128K1M
Max output4K33K
Input $ / M tokens$2.50$0.40
Output $ / M tokens$10$1.20
Results tracked3420

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen Plus leads

Command R+: 29.1 (#309), Qwen Plus: 38.9 (#167)

BenchmarkCommand R+Qwen Plus
LMArena Coding11871328
BigCodeBench Instruct33.8%—
LiveBench Coding19.1%—
BigCodeBench Complete41.9%—
HumanEval+56.7%—
MBPP+63.5%—

Reasoning Qwen Plus leads

Command R+: 9.2 (#344), Qwen Plus: 28.4 (#107)

BenchmarkCommand R+Qwen Plus
LMArena Hard Prompts11861317
DTBench54.9%81.1%
LMCA5%24%
SimpleBench17.4%—
Kagi LLM Benchmark—63.3%
LiveBench Reasoning24.8%—
LiveBench Data Analysis38.1%—
Epoch Capabilities Index119.34—
LiveBench31.8%—

Math Command R+ leads

Command R+: 28.9 (#242), Qwen Plus: 23.3 (#271)

BenchmarkCommand R+Qwen Plus
LMArena Math11881326
OTIS Mock AIME 2024-2025—17.8%
LiveBench Math21.3%—
MATH Level 5—65.3%
FrontierMath (Feb 2025 set)—1.7%

Knowledge Command R+ leads

Command R+: 36.4 (#169), Qwen Plus: 27.4 (#251)

BenchmarkCommand R+Qwen Plus
LMArena Expert11741328
GPQA Diamond—48.1%
Vectara Hallucination Rate6.9%—
MMLU69.4%—

Multilingual Qwen Plus leads

Command R+: 38.6 (#227), Qwen Plus: 45.1 (#175)

BenchmarkCommand R+Qwen Plus
LMArena Non-English12161310
LMArena Chinese12261347
LMArena Japanese11661251
LMArena Russian12271323
LMArena French1209—
LMArena German1216—
LMArena Korean1138—
LMArena Spanish1189—

Instruction Following Qwen Plus leads

Command R+: 60.0 (#254), Qwen Plus: 68.8 (#181)

BenchmarkCommand R+Qwen Plus
LMArena Instruction Following11971303
LiveBench Instruction Following57.6%—

Long Context Qwen Plus leads

Command R+: 37.3 (#219), Qwen Plus: 40.3 (#158)

BenchmarkCommand R+Qwen Plus
LMArena Longer Query12301324

Writing & Preference Qwen Plus leads

Command R+: 43.5 (#228), Qwen Plus: 52.2 (#176)

BenchmarkCommand R+Qwen Plus
LMArena Text12291326
LMArena Creative Writing12351293
LMArena Multi-Turn12131336
LiveBench Language29.7%—

Frequently asked questions

Is Command R+ better than Qwen Plus?

Qwen Plus is the stronger model overall, scoring 37.1 to 32.4 on the Noometry Index.

Which is cheaper, Command R+ or Qwen Plus?

Qwen Plus is cheaper. It lists at $0.40 per million input tokens and $1.20 per million output tokens; Command R+ lists at $2.50 and $10.

Is Command R+ or Qwen Plus better for coding?

Qwen Plus scores higher on coding benchmarks: 38.9 versus 29.1 in the Noometry coding category.

Which has the bigger context window?

Qwen Plus does, with 1M tokens against 128K.

How many benchmarks do Command R+ and Qwen Plus share?

15 benchmarks have published results for both models. Command R+ has 34 scored results on Noometry and Qwen Plus has 20.

Related comparisons

Go deeper