Model comparison

Mistral Medium 3.1 vs Yi 6B

Mistral Medium 3.1 has enough public results to be ranked (#266); Yi 6B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Mistral Medium 3.1 Mistral AI

31.9

Rank #266 Reported

Yi 6B 01.AI

—

Unranked

Summary

  • Yi 6B has downloadable open weights; the other is API-only.

Side by side

Mistral Medium 3.1 and Yi 6B specifications
Mistral Medium 3.1Yi 6B
ProviderMistral AI01.AI
Noometry Index31.9—
Released—2023-11-02
WeightsProprietaryOpen
Context window131K—
Max output105K—
Input $ / M tokens$0.40—
Output $ / M tokens$2—
Results tracked37

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Reasoning Not comparable

Mistral Medium 3.1: 10.6 (#341), Yi 6B: —

Reasoning benchmarks
BenchmarkMistral Medium 3.1Yi 6B
NYT Connections (extended)6.5%—
Thematic Generalization20.3%—
BIG-Bench Hard—47.2%
Epoch Capabilities Index—104.77
HellaSwag—74.4%
WinoGrande—71.3%

Math Not comparable

Mistral Medium 3.1: —, Yi 6B: —

Math benchmarks
BenchmarkMistral Medium 3.1Yi 6B
GSM8K—44.9%

Knowledge Not comparable

Mistral Medium 3.1: —, Yi 6B: —

Knowledge benchmarks
BenchmarkMistral Medium 3.1Yi 6B
ARC (AI2) Challenge—50.3%
MMLU—64%

Writing & Preference Not comparable

Mistral Medium 3.1: 55.5 (#145), Yi 6B: —

Writing & Preference benchmarks
BenchmarkMistral Medium 3.1Yi 6B
EQ-Bench Creative Writing1476—

Frequently asked questions

Is Mistral Medium 3.1 better than Yi 6B?

Mistral Medium 3.1 has enough public results to be ranked (#266); Yi 6B does not yet, so treat this comparison as directional.

How many benchmarks do Mistral Medium 3.1 and Yi 6B share?

0 benchmarks have published results for both models. Mistral Medium 3.1 has 3 scored results on Noometry and Yi 6B has 7.

Related comparisons

Go deeper