Noometry

Model comparison

Command R+ vs Nemotron 3.5 Lightning

Nemotron 3.5 Lightning is the stronger model overall, scoring 40.0 to 32.4 on the Noometry Index.

Last verified . 17 shared benchmarks.

Command R+ Cohere

32.4

Rank #257 Confirmed

Nemotron 3.5 Lightning NVIDIA

40.0

Rank #155 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Command R+ scores higher in 0 categories and Nemotron 3.5 Lightning in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Nemotron 3.5 Lightning leads 26.8 to 9.2.
  • Nemotron 3.5 Lightning is cheaper at $0.05 / $0.20 per million input/output tokens, against $2.50 / $10 for Command R+.
  • Nemotron 3.5 Lightning accepts more context: 262K tokens versus 128K.

Side by side

Command R+Nemotron 3.5 Lightning
ProviderCohereNVIDIA
Noometry Index32.440.0
Released2024-08-302026-08-11
WeightsOpenOpen
Context window128K262K
Max output4K262K
Input $ / M tokens$2.50$0.05
Output $ / M tokens$10$0.20
Results tracked3418

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nemotron 3.5 Lightning leads

Command R+: 29.1 (#309), Nemotron 3.5 Lightning: 40.4 (#141)

BenchmarkCommand R+Nemotron 3.5 Lightning
LMArena Coding11871375
BigCodeBench Instruct33.8%—
LiveBench Coding19.1%—
BigCodeBench Complete41.9%—
HumanEval+56.7%—
MBPP+63.5%—

Reasoning Nemotron 3.5 Lightning leads

Command R+: 9.2 (#344), Nemotron 3.5 Lightning: 26.8 (#127)

BenchmarkCommand R+Nemotron 3.5 Lightning
LMArena Hard Prompts11861337
SimpleBench17.4%—
LiveBench Reasoning24.8%—
DTBench54.9%—
LiveBench Data Analysis38.1%—
LMCA5%—
Epoch Capabilities Index119.34—
LiveBench31.8%—

Math Nemotron 3.5 Lightning leads

Command R+: 28.9 (#242), Nemotron 3.5 Lightning: 37.5 (#155)

BenchmarkCommand R+Nemotron 3.5 Lightning
LMArena Math11881359
LiveBench Math21.3%—

Knowledge Nemotron 3.5 Lightning leads

Command R+: 36.4 (#169), Nemotron 3.5 Lightning: 37.5 (#154)

BenchmarkCommand R+Nemotron 3.5 Lightning
LMArena Expert11741356
Vectara Hallucination Rate6.9%—
MMLU69.4%—

Multilingual Nemotron 3.5 Lightning leads

Command R+: 38.6 (#227), Nemotron 3.5 Lightning: 44.0 (#180)

BenchmarkCommand R+Nemotron 3.5 Lightning
LMArena Non-English12161295
LMArena Chinese12261359
LMArena French12091366
LMArena German12161282
LMArena Japanese11661206
LMArena Korean11381238
LMArena Russian12271253
LMArena Spanish11891345

Instruction Following Nemotron 3.5 Lightning leads

Command R+: 60.0 (#254), Nemotron 3.5 Lightning: 69.6 (#170)

BenchmarkCommand R+Nemotron 3.5 Lightning
LMArena Instruction Following11971318
LiveBench Instruction Following57.6%—

Long Context Nemotron 3.5 Lightning leads

Command R+: 37.3 (#219), Nemotron 3.5 Lightning: 39.9 (#165)

BenchmarkCommand R+Nemotron 3.5 Lightning
LMArena Longer Query12301314

Writing & Preference Nemotron 3.5 Lightning leads

Command R+: 43.5 (#228), Nemotron 3.5 Lightning: 48.5 (#201)

BenchmarkCommand R+Nemotron 3.5 Lightning
LMArena Text12291327
LMArena Creative Writing12351254
LMArena Multi-Turn12131328
EQ-Bench Creative Writing—1280
LiveBench Language29.7%—

Frequently asked questions

Is Command R+ better than Nemotron 3.5 Lightning?

Nemotron 3.5 Lightning is the stronger model overall, scoring 40.0 to 32.4 on the Noometry Index.

Which is cheaper, Command R+ or Nemotron 3.5 Lightning?

Nemotron 3.5 Lightning is cheaper. It lists at $0.05 per million input tokens and $0.20 per million output tokens; Command R+ lists at $2.50 and $10.

Is Command R+ or Nemotron 3.5 Lightning better for coding?

Nemotron 3.5 Lightning scores higher on coding benchmarks: 40.4 versus 29.1 in the Noometry coding category.

Which has the bigger context window?

Nemotron 3.5 Lightning does, with 262K tokens against 128K.

How many benchmarks do Command R+ and Nemotron 3.5 Lightning share?

17 benchmarks have published results for both models. Command R+ has 34 scored results on Noometry and Nemotron 3.5 Lightning has 18.

Related comparisons

Go deeper