Model comparison

Command R+ vs Granite 4.2 30b

Granite 4.2 30b is the stronger model overall, scoring 41.8 to 32.4 on the Noometry Index.

Last verified . 11 shared benchmarks.

Command R+ Cohere

32.4

Rank #257 Confirmed

Granite 4.2 30b IBM

41.8

Rank #130 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Command R+ scores higher in 0 categories and Granite 4.2 30b in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Granite 4.2 30b leads 27.8 to 9.2.

Side by side

Command R+ and Granite 4.2 30b specifications
Command R+Granite 4.2 30b
ProviderCohereIBM
Noometry Index32.441.8
Released2024-08-30—
WeightsOpenOpen
Context window128K—
Max output4K—
Input $ / M tokens$2.50—
Output $ / M tokens$10—
Results tracked3411

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Granite 4.2 30b leads

Command R+: 29.1 (#309), Granite 4.2 30b: 41.0 (#126)

Coding benchmarks
BenchmarkCommand R+Granite 4.2 30b
LMArena Coding11871396
BigCodeBench Instruct33.8%—
LiveBench Coding19.1%—
BigCodeBench Complete41.9%—
HumanEval+56.7%—
MBPP+63.5%—

Reasoning Granite 4.2 30b leads

Command R+: 9.2 (#344), Granite 4.2 30b: 27.8 (#112)

Reasoning benchmarks
BenchmarkCommand R+Granite 4.2 30b
LMArena Hard Prompts11861374
SimpleBench17.4%—
LiveBench Reasoning24.8%—
DTBench54.9%—
LiveBench Data Analysis38.1%—
LMCA5%—
Epoch Capabilities Index119.34—
LiveBench31.8%—

Math Not comparable

Command R+: 28.9 (#242), Granite 4.2 30b: —

Math benchmarks
BenchmarkCommand R+Granite 4.2 30b
LiveBench Math21.3%—
LMArena Math1188—

Knowledge Granite 4.2 30b leads

Command R+: 36.4 (#169), Granite 4.2 30b: 39.1 (#138)

Knowledge benchmarks
BenchmarkCommand R+Granite 4.2 30b
LMArena Expert11741406
Vectara Hallucination Rate6.9%—
MMLU69.4%—

Multilingual Granite 4.2 30b leads

Command R+: 38.6 (#227), Granite 4.2 30b: 47.3 (#151)

Multilingual benchmarks
BenchmarkCommand R+Granite 4.2 30b
LMArena Non-English12161340
LMArena Chinese12261414
LMArena Russian12271343
LMArena French1209—
LMArena German1216—
LMArena Japanese1166—
LMArena Korean1138—
LMArena Spanish1189—

Instruction Following Granite 4.2 30b leads

Command R+: 60.0 (#254), Granite 4.2 30b: 71.2 (#155)

Instruction Following benchmarks
BenchmarkCommand R+Granite 4.2 30b
LMArena Instruction Following11971347
LiveBench Instruction Following57.6%—

Long Context Granite 4.2 30b leads

Command R+: 37.3 (#219), Granite 4.2 30b: 41.4 (#140)

Long Context benchmarks
BenchmarkCommand R+Granite 4.2 30b
LMArena Longer Query12301359

Writing & Preference Granite 4.2 30b leads

Command R+: 43.5 (#228), Granite 4.2 30b: 53.8 (#156)

Writing & Preference benchmarks
BenchmarkCommand R+Granite 4.2 30b
LMArena Text12291361
LMArena Creative Writing12351288
LMArena Multi-Turn12131339
LiveBench Language29.7%—

Frequently asked questions

Is Command R+ better than Granite 4.2 30b?

Granite 4.2 30b is the stronger model overall, scoring 41.8 to 32.4 on the Noometry Index.

Is Command R+ or Granite 4.2 30b better for coding?

Granite 4.2 30b scores higher on coding benchmarks: 41.0 versus 29.1 in the Noometry coding category.

How many benchmarks do Command R+ and Granite 4.2 30b share?

11 benchmarks have published results for both models. Command R+ has 34 scored results on Noometry and Granite 4.2 30b has 11.

Related comparisons

Go deeper