Model comparison

Ministral 8B vs Yi-Large

Ministral 8B has enough public results to be ranked (#321); Yi-Large does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Ministral 8B Mistral AI

27.8

Rank #321 Confirmed

Yi-Large 01.AI

37.6

Unranked Sparse

Summary

  • Ministral 8B has downloadable open weights; the other is API-only.

Side by side

Ministral 8B and Yi-Large specifications
Ministral 8BYi-Large
ProviderMistral AI01.AI
Noometry Index27.837.6
Released2024-10-012024-05-13
WeightsOpenProprietary
Context window128K—
Max output128K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.10—
Results tracked173

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Yi-Large leads

Ministral 8B: 34.4 (#226), Yi-Large: 36.1 (#201)

Coding benchmarks
BenchmarkMinistral 8BYi-Large
BigCodeBench Instruct—37.7%
LMArena Coding1202—
BigCodeBench Complete—47.2%

Agentic & Tool Use Not comparable

Ministral 8B: 16.2 (#140), Yi-Large: —

Agentic & Tool Use benchmarks
BenchmarkMinistral 8BYi-Large
Berkeley Function Calling Leaderboard11.1%—

Reasoning Not comparable

Ministral 8B: 17.7 (#279), Yi-Large: —

Reasoning benchmarks
BenchmarkMinistral 8BYi-Large
LMArena Hard Prompts1191—
DTBench45.7%—

Math Not comparable

Ministral 8B: 23.7 (#262), Yi-Large: —

Math benchmarks
BenchmarkMinistral 8BYi-Large
LMArena Math1188—
MATH Level 514.9%—

Knowledge Not comparable

Ministral 8B: 12.5 (#292), Yi-Large: —

Knowledge benchmarks
BenchmarkMinistral 8BYi-Large
GPQA Diamond27.1%—
Vectara Hallucination Rate7.4%—
LMArena Expert1170—
MMLU—79.3%

Multilingual Not comparable

Ministral 8B: 35.3 (#242), Yi-Large: —

Multilingual benchmarks
BenchmarkMinistral 8BYi-Large
LMArena Non-English1165—
LMArena Chinese1193—
LMArena Russian1195—

Instruction Following Not comparable

Ministral 8B: 60.7 (#245), Yi-Large: —

Instruction Following benchmarks
BenchmarkMinistral 8BYi-Large
LMArena Instruction Following1161—

Long Context Not comparable

Ministral 8B: 36.7 (#222), Yi-Large: —

Long Context benchmarks
BenchmarkMinistral 8BYi-Large
LMArena Longer Query1212—

Writing & Preference Not comparable

Ministral 8B: 39.8 (#241), Yi-Large: —

Writing & Preference benchmarks
BenchmarkMinistral 8BYi-Large
LMArena Text1191—
LMArena Creative Writing1175—
LMArena Multi-Turn1166—

Frequently asked questions

Is Ministral 8B better than Yi-Large?

Ministral 8B has enough public results to be ranked (#321); Yi-Large does not yet, so treat this comparison as directional.

Is Ministral 8B or Yi-Large better for coding?

Yi-Large scores higher on coding benchmarks: 36.1 versus 34.4 in the Noometry coding category.

How many benchmarks do Ministral 8B and Yi-Large share?

0 benchmarks have published results for both models. Ministral 8B has 17 scored results on Noometry and Yi-Large has 3.

Related comparisons

Go deeper