Model comparison

Mistral Nemo vs Yi-Large

Mistral Nemo has enough public results to be ranked (#332); Yi-Large does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Mistral Nemo Mistral AI

25.9

Rank #332 Confirmed

Yi-Large 01.AI

37.6

Unranked Sparse

Summary

  • Mistral Nemo has downloadable open weights; the other is API-only.

Side by side

Mistral Nemo and Yi-Large specifications
Mistral NemoYi-Large
ProviderMistral AI01.AI
Noometry Index25.937.6
Released2024-07-012024-05-13
WeightsOpenProprietary
Context window128K—
Max output128K—
Input $ / M tokens$0.15—
Output $ / M tokens$0.15—
Results tracked103

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Nemo: —, Yi-Large: 36.1 (#201)

Coding benchmarks
BenchmarkMistral NemoYi-Large
BigCodeBench Instruct—37.7%
BigCodeBench Complete—47.2%

Agentic & Tool Use Not comparable

Mistral Nemo: 23.3 (#118), Yi-Large: —

Agentic & Tool Use benchmarks
BenchmarkMistral NemoYi-Large
Berkeley Function Calling Leaderboard27.6%—
BALROG17.6%—

Reasoning Not comparable

Mistral Nemo: 19.9 (#230), Yi-Large: —

Reasoning benchmarks
BenchmarkMistral NemoYi-Large
DTBench48.6%—
Epoch Capabilities Index118.63—
PIQA83.5%—

Math Not comparable

Mistral Nemo: 23.5 (#263), Yi-Large: —

Math benchmarks
BenchmarkMistral NemoYi-Large
MATH Level 510.8%—
GSM8K84.2%—

Knowledge Not comparable

Mistral Nemo: 12.3 (#293), Yi-Large: —

Knowledge benchmarks
BenchmarkMistral NemoYi-Large
GPQA Diamond29.9%—
BoolQ82.5%—
MMLU—79.3%

Writing & Preference Not comparable

Mistral Nemo: 28.6 (#291), Yi-Large: —

Writing & Preference benchmarks
BenchmarkMistral NemoYi-Large
EQ-Bench Creative Writing881—

Frequently asked questions

Is Mistral Nemo better than Yi-Large?

Mistral Nemo has enough public results to be ranked (#332); Yi-Large does not yet, so treat this comparison as directional.

How many benchmarks do Mistral Nemo and Yi-Large share?

0 benchmarks have published results for both models. Mistral Nemo has 10 scored results on Noometry and Yi-Large has 3.

Related comparisons

Go deeper