Noometry

Model comparison

Command R vs Llama 3.1 Nemotron 70b Instruct

Llama 3.1 Nemotron 70b Instruct is the stronger model overall, scoring 37.6 to 31.4 on the Noometry Index.

Last verified . 14 shared benchmarks.

Command R Cohere

31.4

Rank #272 Confirmed

Llama 3.1 Nemotron 70b Instruct NVIDIA

37.6

Rank #203 Confirmed

Summary

  • They share 14 benchmarks with published results for both. Command R scores higher in 0 categories and Llama 3.1 Nemotron 70b Instruct in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Llama 3.1 Nemotron 70b Instruct leads 25.0 to 13.8.

Side by side

Command RLlama 3.1 Nemotron 70b Instruct
ProviderCohereNVIDIA
Noometry Index31.437.6
Released2024-08-302024-12-18
WeightsOpenOpen
Context window128K—
Max output4K—
Input $ / M tokens$0.15—
Output $ / M tokens$0.60—
Results tracked2914

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Llama 3.1 Nemotron 70b Instruct leads

Command R: 29.3 (#306), Llama 3.1 Nemotron 70b Instruct: 35.9 (#216)

BenchmarkCommand RLlama 3.1 Nemotron 70b Instruct
BigCodeBench Instruct37.1%38.7%
LMArena Coding11691272
BigCodeBench Complete45.2%48.2%
LiveBench Coding17.9%—

Reasoning Llama 3.1 Nemotron 70b Instruct leads

Command R: 13.8 (#331), Llama 3.1 Nemotron 70b Instruct: 25.0 (#152)

BenchmarkCommand RLlama 3.1 Nemotron 70b Instruct
LMArena Hard Prompts11641266
LiveBench Reasoning21.9%—
DTBench46.4%—
LiveBench Data Analysis33.3%—
LMCA9.2%—
LiveBench27.5%—

Math Llama 3.1 Nemotron 70b Instruct leads

Command R: 28.0 (#246), Llama 3.1 Nemotron 70b Instruct: 35.5 (#182)

BenchmarkCommand RLlama 3.1 Nemotron 70b Instruct
LMArena Math11551271
LiveBench Math19.4%—

Knowledge Llama 3.1 Nemotron 70b Instruct leads

Command R: 31.0 (#221), Llama 3.1 Nemotron 70b Instruct: 34.1 (#199)

BenchmarkCommand RLlama 3.1 Nemotron 70b Instruct
LMArena Expert11381242
MMLU65.2%—

Multilingual Llama 3.1 Nemotron 70b Instruct leads

Command R: 35.7 (#245), Llama 3.1 Nemotron 70b Instruct: 40.5 (#217)

BenchmarkCommand RLlama 3.1 Nemotron 70b Instruct
LMArena Non-English11741245
LMArena Chinese11821263
LMArena Russian11741227
LMArena French1162—
LMArena German1176—
LMArena Japanese1143—
LMArena Korean1163—
LMArena Spanish1151—

Instruction Following Llama 3.1 Nemotron 70b Instruct leads

Command R: 58.1 (#261), Llama 3.1 Nemotron 70b Instruct: 65.9 (#213)

BenchmarkCommand RLlama 3.1 Nemotron 70b Instruct
LMArena Instruction Following11671252
LiveBench Instruction Following55.6%—

Long Context Llama 3.1 Nemotron 70b Instruct leads

Command R: 36.3 (#231), Llama 3.1 Nemotron 70b Instruct: 37.6 (#215)

BenchmarkCommand RLlama 3.1 Nemotron 70b Instruct
LMArena Longer Query11981238

Writing & Preference Llama 3.1 Nemotron 70b Instruct leads

Command R: 38.2 (#254), Llama 3.1 Nemotron 70b Instruct: 48.4 (#203)

BenchmarkCommand RLlama 3.1 Nemotron 70b Instruct
LMArena Text11871283
LMArena Creative Writing11701269
LMArena Multi-Turn11631275
LiveBench Language16.7%—

Frequently asked questions

Is Command R better than Llama 3.1 Nemotron 70b Instruct?

Llama 3.1 Nemotron 70b Instruct is the stronger model overall, scoring 37.6 to 31.4 on the Noometry Index.

Is Command R or Llama 3.1 Nemotron 70b Instruct better for coding?

Llama 3.1 Nemotron 70b Instruct scores higher on coding benchmarks: 35.9 versus 29.3 in the Noometry coding category.

How many benchmarks do Command R and Llama 3.1 Nemotron 70b Instruct share?

14 benchmarks have published results for both models. Command R has 29 scored results on Noometry and Llama 3.1 Nemotron 70b Instruct has 14.

Related comparisons

Go deeper