Model comparison

Command R vs Yi 6B

Command R has enough public results to be ranked (#267); Yi 6B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Command R Cohere

31.0

Rank #267 Confirmed

Yi 6B 01.AI

—

Unranked

Summary

  • They share 1 benchmark with published results for both.

Side by side

Command R and Yi 6B specifications
Command RYi 6B
ProviderCohere01.AI
Noometry Index31.0—
Released2024-08-302023-11-02
WeightsOpenOpen
Context window128K—
Max output4K—
Input $ / M tokens$0.15—
Output $ / M tokens$0.60—
Results tracked297

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Command R: 28.8 (#301), Yi 6B: —

Coding benchmarks
BenchmarkCommand RYi 6B
BigCodeBench Instruct37.1%—
LiveBench Coding17.9%—
LMArena Coding1170—
BigCodeBench Complete45.2%—

Reasoning Not comparable

Command R: 13.3 (#329), Yi 6B: —

Reasoning benchmarks
BenchmarkCommand RYi 6B
LiveBench Reasoning21.9%—
LMArena Hard Prompts1164—
DTBench46.4%—
LiveBench Data Analysis33.3%—
LMCA9.2%—
BIG-Bench Hard—47.2%
Epoch Capabilities Index—104.37
HellaSwag—74.4%
LiveBench27.5%—
WinoGrande—71.3%

Math Not comparable

Command R: 25.8 (#244), Yi 6B: —

Math benchmarks
BenchmarkCommand RYi 6B
LiveBench Math19.4%—
LMArena Math1155—
GSM8K—44.9%

Knowledge Not comparable

Command R: 30.5 (#219), Yi 6B: —

Knowledge benchmarks
BenchmarkCommand RYi 6B
MMLU65.2%64%
LMArena Expert1138—
ARC (AI2) Challenge—50.3%

Multilingual Not comparable

Command R: 35.9 (#240), Yi 6B: —

Multilingual benchmarks
BenchmarkCommand RYi 6B
LMArena Non-English1174—
LMArena Chinese1182—
LMArena French1161—
LMArena German1176—
LMArena Japanese1143—
LMArena Korean1162—
LMArena Russian1174—
LMArena Spanish1150—

Instruction Following Not comparable

Command R: 58.3 (#256), Yi 6B: —

Instruction Following benchmarks
BenchmarkCommand RYi 6B
LiveBench Instruction Following55.6%—
LMArena Instruction Following1167—

Long Context Not comparable

Command R: 36.3 (#226), Yi 6B: —

Long Context benchmarks
BenchmarkCommand RYi 6B
LMArena Longer Query1198—

Writing & Preference Not comparable

Command R: 38.4 (#248), Yi 6B: —

Writing & Preference benchmarks
BenchmarkCommand RYi 6B
LMArena Text1187—
LMArena Creative Writing1170—
LMArena Multi-Turn1163—
LiveBench Language16.7%—

Frequently asked questions

Is Command R better than Yi 6B?

Command R has enough public results to be ranked (#267); Yi 6B does not yet, so treat this comparison as directional.

How many benchmarks do Command R and Yi 6B share?

1 benchmark has published results for both models. Command R has 29 scored results on Noometry and Yi 6B has 7.

Related comparisons

Go deeper