Model comparison

Ministral 8B vs Yi 6B

Ministral 8B has enough public results to be ranked (#325); Yi 6B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Ministral 8B Mistral AI

28.2

Rank #325 Confirmed

Yi 6B 01.AI

—

Unranked

Side by side

Ministral 8B and Yi 6B specifications
Ministral 8BYi 6B
ProviderMistral AI01.AI
Noometry Index28.2—
Released2024-10-012023-11-02
WeightsOpenOpen
Context window262K—
Max output262K—
Input $ / M tokens$0.15—
Output $ / M tokens$0.15—
Results tracked177

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Ministral 8B: 35.0 (#230), Yi 6B: —

Coding benchmarks
BenchmarkMinistral 8BYi 6B
LMArena Coding1202—

Agentic & Tool Use Not comparable

Ministral 8B: 16.4 (#148), Yi 6B: —

Agentic & Tool Use benchmarks
BenchmarkMinistral 8BYi 6B
Berkeley Function Calling Leaderboard11.1%—

Reasoning Not comparable

Ministral 8B: 18.4 (#281), Yi 6B: —

Reasoning benchmarks
BenchmarkMinistral 8BYi 6B
LMArena Hard Prompts1191—
DTBench45.7%—
BIG-Bench Hard—47.2%
Epoch Capabilities Index—104.77
HellaSwag—74.4%
WinoGrande—71.3%

Math Not comparable

Ministral 8B: 25.7 (#267), Yi 6B: —

Math benchmarks
BenchmarkMinistral 8BYi 6B
LMArena Math1188—
MATH Level 514.9%—
GSM8K—44.9%

Knowledge Not comparable

Ministral 8B: 12.6 (#297), Yi 6B: —

Knowledge benchmarks
BenchmarkMinistral 8BYi 6B
GPQA Diamond27.1%—
Vectara Hallucination Rate7.4%—
LMArena Expert1170—
ARC (AI2) Challenge—50.3%
MMLU—64%

Multilingual Not comparable

Ministral 8B: 35.1 (#247), Yi 6B: —

Multilingual benchmarks
BenchmarkMinistral 8BYi 6B
LMArena Non-English1165—
LMArena Chinese1193—
LMArena Russian1195—

Instruction Following Not comparable

Ministral 8B: 60.5 (#250), Yi 6B: —

Instruction Following benchmarks
BenchmarkMinistral 8BYi 6B
LMArena Instruction Following1161—

Long Context Not comparable

Ministral 8B: 36.7 (#227), Yi 6B: —

Long Context benchmarks
BenchmarkMinistral 8BYi 6B
LMArena Longer Query1212—

Writing & Preference Not comparable

Ministral 8B: 39.6 (#246), Yi 6B: —

Writing & Preference benchmarks
BenchmarkMinistral 8BYi 6B
LMArena Text1191—
LMArena Creative Writing1175—
LMArena Multi-Turn1166—

Frequently asked questions

Is Ministral 8B better than Yi 6B?

Ministral 8B has enough public results to be ranked (#325); Yi 6B does not yet, so treat this comparison as directional.

How many benchmarks do Ministral 8B and Yi 6B share?

0 benchmarks have published results for both models. Ministral 8B has 17 scored results on Noometry and Yi 6B has 7.

Related comparisons

Go deeper