Model comparison

Command R+ vs Qwen2.5 32B Instruct

Command R+ is the stronger model overall, scoring 32.4 to 30.1 on the Noometry Index. Qwen2.5 32B Instruct costs 3.6× less per token, which makes it the better buy when Command R+'s lead doesn't matter for your workload.

Last verified . 3 shared benchmarks.

Command R+ Cohere

32.4

Rank #257 Confirmed

Qwen2.5 32B Instruct Alibaba (Qwen)

30.1

Rank #297 Confirmed

Summary

  • They share 3 benchmarks with published results for both. Command R+ scores higher in 2 categories and Qwen2.5 32B Instruct in 2 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Command R+ leads 28.9 to 16.2.
  • The biggest single-benchmark swing is BigCodeBench Instruct: 33.8% for Command R+ and 45% for Qwen2.5 32B Instruct.
  • Qwen2.5 32B Instruct is cheaper at $0.70 / $2.80 per million input/output tokens, against $2.50 / $10 for Command R+.
  • Qwen2.5 32B Instruct accepts more context: 131K tokens versus 128K.

Side by side

Command R+ and Qwen2.5 32B Instruct specifications
Command R+Qwen2.5 32B Instruct
ProviderCohereAlibaba (Qwen)
Noometry Index32.430.1
Released2024-08-302024-09
WeightsOpenOpen
Context window128K131K
Max output4K8K
Input $ / M tokens$2.50$0.70
Output $ / M tokens$10$2.80
Results tracked347

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen2.5 32B Instruct leads

Command R+: 29.1 (#309), Qwen2.5 32B Instruct: 38.7 (#169)

Coding benchmarks
BenchmarkCommand R+Qwen2.5 32B Instruct
BigCodeBench Instruct33.8%45%
BigCodeBench Complete41.9%52.3%
LiveBench Coding19.1%—
LMArena Coding1187—
HumanEval+56.7%—
MBPP+63.5%—

Reasoning Qwen2.5 32B Instruct leads

Command R+: 9.2 (#344), Qwen2.5 32B Instruct: 19.2 (#266)

Reasoning benchmarks
BenchmarkCommand R+Qwen2.5 32B Instruct
Epoch Capabilities Index119.34128.52
SimpleBench17.4%—
Chess Puzzles—0%
LiveBench Reasoning24.8%—
LMArena Hard Prompts1186—
DTBench54.9%—
LiveBench Data Analysis38.1%—
LMCA5%—
LiveBench31.8%—

Math Command R+ leads

Command R+: 28.9 (#242), Qwen2.5 32B Instruct: 16.2 (#296)

Math benchmarks
BenchmarkCommand R+Qwen2.5 32B Instruct
OTIS Mock AIME 2024-2025—7.4%
LiveBench Math21.3%—
LMArena Math1188—
MATH Level 5—56.1%

Knowledge Command R+ leads

Command R+: 36.4 (#169), Qwen2.5 32B Instruct: 24.9 (#266)

Knowledge benchmarks
BenchmarkCommand R+Qwen2.5 32B Instruct
GPQA Diamond—46.1%
Vectara Hallucination Rate6.9%—
LMArena Expert1174—
MMLU69.4%—

Multilingual Not comparable

Command R+: 38.6 (#227), Qwen2.5 32B Instruct: —

Multilingual benchmarks
BenchmarkCommand R+Qwen2.5 32B Instruct
LMArena Non-English1216—
LMArena Chinese1226—
LMArena French1209—
LMArena German1216—
LMArena Japanese1166—
LMArena Korean1138—
LMArena Russian1227—
LMArena Spanish1189—

Instruction Following Not comparable

Command R+: 60.0 (#254), Qwen2.5 32B Instruct: —

Instruction Following benchmarks
BenchmarkCommand R+Qwen2.5 32B Instruct
LiveBench Instruction Following57.6%—
LMArena Instruction Following1197—

Long Context Not comparable

Command R+: 37.3 (#219), Qwen2.5 32B Instruct: —

Long Context benchmarks
BenchmarkCommand R+Qwen2.5 32B Instruct
LMArena Longer Query1230—

Writing & Preference Not comparable

Command R+: 43.5 (#228), Qwen2.5 32B Instruct: —

Writing & Preference benchmarks
BenchmarkCommand R+Qwen2.5 32B Instruct
LMArena Text1229—
LMArena Creative Writing1235—
LMArena Multi-Turn1213—
LiveBench Language29.7%—

Frequently asked questions

Is Command R+ better than Qwen2.5 32B Instruct?

Command R+ is the stronger model overall, scoring 32.4 to 30.1 on the Noometry Index. Qwen2.5 32B Instruct costs 3.6× less per token, which makes it the better buy when Command R+'s lead doesn't matter for your workload.

Which is cheaper, Command R+ or Qwen2.5 32B Instruct?

Qwen2.5 32B Instruct is cheaper. It lists at $0.70 per million input tokens and $2.80 per million output tokens; Command R+ lists at $2.50 and $10.

Is Command R+ or Qwen2.5 32B Instruct better for coding?

Qwen2.5 32B Instruct scores higher on coding benchmarks: 38.7 versus 29.1 in the Noometry coding category.

Which has the bigger context window?

Qwen2.5 32B Instruct does, with 131K tokens against 128K.

How many benchmarks do Command R+ and Qwen2.5 32B Instruct share?

3 benchmarks have published results for both models. Command R+ has 34 scored results on Noometry and Qwen2.5 32B Instruct has 7.

Related comparisons

Go deeper