Model comparison

Pixtral Large vs Yi-Lightning

Yi-Lightning is the stronger model overall, scoring 37.1 to 32.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Pixtral Large Mistral AI

32.2

Rank #259 Reported

Yi-Lightning 01.AI

37.1

Rank #209 Confirmed

Summary

  • The widest gap is in writing & preference, where Yi-Lightning leads 50.2 to 32.9.
  • Pixtral Large has downloadable open weights; the other is API-only.

Side by side

Pixtral Large and Yi-Lightning specifications
Pixtral LargeYi-Lightning
ProviderMistral AI01.AI
Noometry Index32.237.1
Released2024-11-012024-12-02
WeightsOpenProprietary
Context window128K—
Max output128K—
Input $ / M tokens$2—
Output $ / M tokens$6—
Results tracked318

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Pixtral Large: —, Yi-Lightning: 27.4 (#320)

Coding benchmarks
BenchmarkPixtral LargeYi-Lightning
Aider Polyglot—12.9%
LMArena Coding—1312

Reasoning Yi-Lightning leads

Pixtral Large: 21.7 (#218), Yi-Lightning: 25.9 (#139)

Reasoning benchmarks
BenchmarkPixtral LargeYi-Lightning
EnigmaEval0.8%—
LMArena Hard Prompts—1302

Math Not comparable

Pixtral Large: —, Yi-Lightning: 36.2 (#172)

Math benchmarks
BenchmarkPixtral LargeYi-Lightning
LMArena Math—1300

Knowledge Not comparable

Pixtral Large: —, Yi-Lightning: 35.4 (#185)

Knowledge benchmarks
BenchmarkPixtral LargeYi-Lightning
LMArena Expert—1286

Multimodal Not comparable

Pixtral Large: 30.6 (#111), Yi-Lightning: —

Multimodal benchmarks
BenchmarkPixtral LargeYi-Lightning
LMArena Vision1089—

Multilingual Not comparable

Pixtral Large: —, Yi-Lightning: 42.2 (#196)

Multilingual benchmarks
BenchmarkPixtral LargeYi-Lightning
LMArena Non-English—1269
LMArena Chinese—1320
LMArena French—1305
LMArena German—1267
LMArena Japanese—1228
LMArena Korean—1192
LMArena Russian—1255
LMArena Spanish—1315

Instruction Following Not comparable

Pixtral Large: —, Yi-Lightning: 67.4 (#196)

Instruction Following benchmarks
BenchmarkPixtral LargeYi-Lightning
LMArena Instruction Following—1278

Long Context Not comparable

Pixtral Large: —, Yi-Lightning: 39.4 (#181)

Long Context benchmarks
BenchmarkPixtral LargeYi-Lightning
LMArena Longer Query—1297

Writing & Preference Yi-Lightning leads

Pixtral Large: 32.9 (#278), Yi-Lightning: 50.2 (#184)

Writing & Preference benchmarks
BenchmarkPixtral LargeYi-Lightning
LMArena Text—1302
LMArena Creative Writing—1280
EQ-Bench Creative Writing988—
LMArena Multi-Turn—1311

Frequently asked questions

Is Pixtral Large better than Yi-Lightning?

Yi-Lightning is the stronger model overall, scoring 37.1 to 32.2 on the Noometry Index.

How many benchmarks do Pixtral Large and Yi-Lightning share?

0 benchmarks have published results for both models. Pixtral Large has 3 scored results on Noometry and Yi-Lightning has 18.

Related comparisons

Go deeper