Noometry

Model comparison

Command R+ vs Gemini 1.5 Flash 8B

Command R+ is the stronger model overall, scoring 32.0 to 29.7 on the Noometry Index.

Last verified . 18 shared benchmarks.

Command R+ Cohere

32.0

Rank #251 Confirmed

Gemini 1.5 Flash 8B Google

29.7

Rank #292 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Command R+ scores higher in 5 categories and Gemini 1.5 Flash 8B in 3 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Command R+ leads 35.9 to 16.0.
  • Command R+ has downloadable open weights; the other is API-only.

Side by side

Command R+Gemini 1.5 Flash 8B
ProviderCohereGoogle
Noometry Index32.029.7
Released2024-08-302024-10-03
WeightsOpenProprietary
Context window128K—
Max output4K—
Input $ / M tokens$2.50—
Output $ / M tokens$10—
Results tracked3421

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 1.5 Flash 8B leads

Command R+: 28.6 (#304), Gemini 1.5 Flash 8B: 34.9 (#221)

BenchmarkCommand R+Gemini 1.5 Flash 8B
LMArena Coding11871218
BigCodeBench Instruct33.8%—
LiveBench Coding19.1%—
BigCodeBench Complete41.9%—
HumanEval+56.7%—
MBPP+63.5%—

Reasoning Gemini 1.5 Flash 8B leads

Command R+: 8.9 (#341), Gemini 1.5 Flash 8B: 19.2 (#242)

BenchmarkCommand R+Gemini 1.5 Flash 8B
LMArena Hard Prompts11861210
DTBench54.9%50%
SimpleBench17.4%—
LiveBench Reasoning24.8%—
LiveBench Data Analysis38.1%—
LMCA5%—
Epoch Capabilities Index119.28—
LiveBench31.8%—

Math Command R+ leads

Command R+: 26.6 (#239), Gemini 1.5 Flash 8B: 13.3 (#296)

BenchmarkCommand R+Gemini 1.5 Flash 8B
LMArena Math11881207
OTIS Mock AIME 2024-2025—4.6%
LiveBench Math21.3%—

Knowledge Command R+ leads

Command R+: 35.9 (#165), Gemini 1.5 Flash 8B: 16.0 (#285)

BenchmarkCommand R+Gemini 1.5 Flash 8B
LMArena Expert11741185
GPQA Diamond—33%
Vectara Hallucination Rate6.9%—
MMLU69.4%—

Multimodal Not comparable

Command R+: —, Gemini 1.5 Flash 8B: 27.6 (#110)

BenchmarkCommand R+Gemini 1.5 Flash 8B
LMArena Vision—1044

Multilingual Too close to call

Command R+: 38.8 (#222), Gemini 1.5 Flash 8B: 38.6 (#224)

BenchmarkCommand R+Gemini 1.5 Flash 8B
LMArena Non-English12161215
LMArena Chinese12261231
LMArena French12081233
LMArena German12161206
LMArena Japanese11661150
LMArena Korean11381140
LMArena Russian12271236
LMArena Spanish11891212

Instruction Following Gemini 1.5 Flash 8B leads

Command R+: 60.2 (#249), Gemini 1.5 Flash 8B: 63.1 (#231)

BenchmarkCommand R+Gemini 1.5 Flash 8B
LMArena Instruction Following11971199
LiveBench Instruction Following57.6%—

Long Context Too close to call

Command R+: 37.3 (#214), Gemini 1.5 Flash 8B: 36.9 (#220)

BenchmarkCommand R+Gemini 1.5 Flash 8B
LMArena Longer Query12311219

Writing & Preference Too close to call

Command R+: 43.7 (#223), Gemini 1.5 Flash 8B: 43.0 (#227)

BenchmarkCommand R+Gemini 1.5 Flash 8B
LMArena Text12291226
LMArena Creative Writing12351218
LMArena Multi-Turn12131185
LiveBench Language29.7%—

Frequently asked questions

Is Command R+ better than Gemini 1.5 Flash 8B?

Command R+ is the stronger model overall, scoring 32.0 to 29.7 on the Noometry Index.

Is Command R+ or Gemini 1.5 Flash 8B better for coding?

Gemini 1.5 Flash 8B scores higher on coding benchmarks: 34.9 versus 28.6 in the Noometry coding category.

How many benchmarks do Command R+ and Gemini 1.5 Flash 8B share?

18 benchmarks have published results for both models. Command R+ has 34 scored results on Noometry and Gemini 1.5 Flash 8B has 21.

Related comparisons

Go deeper