Noometry

Model comparison

Claude 3.7 Sonnet vs Command R+

Claude 3.7 Sonnet is the stronger model overall, scoring 39.5 to 32.4 on the Noometry Index.

Last verified . 26 shared benchmarks.

Claude 3.7 Sonnet Anthropic

39.5

Rank #164 Confirmed

Command R+ Cohere

32.4

Rank #257 Confirmed

Summary

  • They share 26 benchmarks with published results for both. Claude 3.7 Sonnet scores higher in 8 categories and Command R+ in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in instruction following, where Claude 3.7 Sonnet leads 72.9 to 60.0.
  • The biggest single-benchmark swing is LiveBench Reasoning: 87.8% for Claude 3.7 Sonnet and 24.8% for Command R+.
  • Command R+ has downloadable open weights; the other is API-only.

Side by side

Claude 3.7 SonnetCommand R+
ProviderAnthropicCohere
Noometry Index39.532.4
Released2025-02-242024-08-30
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$2.50
Output $ / M tokens—$10
Results tracked5834

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 40.6 (#136), Command R+: 29.1 (#309)

BenchmarkClaude 3.7 SonnetCommand R+
LiveBench Coding74.5%19.1%
LMArena Coding13611187
SWE-bench Verified61%—
SWE-bench Verified (bash only)52.8%—
Aider Polyglot64.9%—
GSO3.8%—
BigCodeBench Instruct—33.8%
BigCodeBench Complete—41.9%
CadEval54%—
HumanEval+—56.7%
MBPP+—63.5%

Agentic & Tool Use Not comparable

Claude 3.7 Sonnet: 34.1 (#50), Command R+: —

BenchmarkClaude 3.7 SonnetCommand R+
TheAgentCompany30.9%—
Cybench20%—
DeepResearch Bench43.6%—
OSWorld35.8%—
METR Time Horizons60%—

Reasoning Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 18.6 (#277), Command R+: 9.2 (#344)

BenchmarkClaude 3.7 SonnetCommand R+
SimpleBench46.4%17.4%
LiveBench Reasoning87.8%24.8%
LMArena Hard Prompts13331186
LiveBench Data Analysis74%38.1%
Epoch Capabilities Index141.16119.34
LiveBench76.1%31.8%
ARC-AGI-20.9%—
ARC-AGI-128.6%—
EnigmaEval4.2%—
DTBench—54.9%
LMCA—5%
ForecastBench61.8—

Math Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 37.5 (#153), Command R+: 28.9 (#242)

BenchmarkClaude 3.7 SonnetCommand R+
LiveBench Math79%21.3%
LMArena Math13371188
OTIS Mock AIME 2024-202557.8%—
Omni-MATH33%—
MATH Level 591.2%—
FrontierMath (Feb 2025 set)4.1%—

Knowledge Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 39.8 (#130), Command R+: 36.4 (#169)

BenchmarkClaude 3.7 SonnetCommand R+
LMArena Expert13211174
GPQA Diamond79.7%—
Humanity's Last Exam8%—
MMLU-Pro78.4%—
Confabulations14.7%—
Vectara Hallucination Rate—6.9%
GPQA (HELM)60.8%—
MMLU—69.4%

Multimodal Not comparable

Claude 3.7 Sonnet: 33.7 (#95), Command R+: —

BenchmarkClaude 3.7 SonnetCommand R+
LMArena Vision1169—
GeoBench68%—
VPCT39%—
SpatialViz-Bench33.9%—

Multilingual Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 44.1 (#179), Command R+: 38.6 (#227)

BenchmarkClaude 3.7 SonnetCommand R+
LMArena Non-English12961216
LMArena Chinese12991226
LMArena French13031209
LMArena German13011216
LMArena Japanese12671166
LMArena Korean12491138
LMArena Russian13111227
LMArena Spanish12981189

Instruction Following Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 72.9 (#125), Command R+: 60.0 (#254)

BenchmarkClaude 3.7 SonnetCommand R+
LiveBench Instruction Following81.3%57.6%
LMArena Instruction Following13521197
IFEval83.4%—

Long Context Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 50.3 (#10), Command R+: 37.3 (#219)

BenchmarkClaude 3.7 SonnetCommand R+
LMArena Longer Query13731230
Fiction.LiveBench83.3%—

Writing & Preference Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 54.4 (#150), Command R+: 43.5 (#228)

BenchmarkClaude 3.7 SonnetCommand R+
LMArena Text13141229
LMArena Creative Writing13321235
LMArena Multi-Turn13391213
LiveBench Language59.9%29.7%
Short-Story Creative Writing81.1%—
EQ-Bench Creative Writing1412—
WildBench81.4%—

Frequently asked questions

Is Claude 3.7 Sonnet better than Command R+?

Claude 3.7 Sonnet is the stronger model overall, scoring 39.5 to 32.4 on the Noometry Index.

Is Claude 3.7 Sonnet or Command R+ better for coding?

Claude 3.7 Sonnet scores higher on coding benchmarks: 40.6 versus 29.1 in the Noometry coding category.

How many benchmarks do Claude 3.7 Sonnet and Command R+ share?

26 benchmarks have published results for both models. Claude 3.7 Sonnet has 58 scored results on Noometry and Command R+ has 34.

Related comparisons

Go deeper