Model comparison

Gemini Advanced 0514 vs Yi-Lightning

Gemini Advanced 0514 and Yi-Lightning score almost the same on the Noometry Index (37.1 vs 36.5), so choose on price, context window or the category you care about most.

Last verified . 17 shared benchmarks.

Gemini Advanced 0514 Google

37.1

Rank #195 Confirmed

Yi-Lightning 01.AI

36.5

Rank #206 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemini Advanced 0514 scores higher in 2 categories and Yi-Lightning in 6 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Gemini Advanced 0514 leads 36.0 to 27.0.

Side by side

Gemini Advanced 0514 and Yi-Lightning specifications
Gemini Advanced 0514Yi-Lightning
ProviderGoogle01.AI
Noometry Index37.136.5
Released—2024-12-02
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1718

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini Advanced 0514 leads

Gemini Advanced 0514: 36.0 (#202), Yi-Lightning: 27.0 (#315)

Coding benchmarks
BenchmarkGemini Advanced 0514Yi-Lightning
LMArena Coding12551313
Aider Polyglot—12.9%

Reasoning Yi-Lightning leads

Gemini Advanced 0514: 23.6 (#163), Yi-Lightning: 24.9 (#137)

Reasoning benchmarks
BenchmarkGemini Advanced 0514Yi-Lightning
LMArena Hard Prompts12481302

Math Too close to call

Gemini Advanced 0514: 32.9 (#181), Yi-Lightning: 33.5 (#173)

Math benchmarks
BenchmarkGemini Advanced 0514Yi-Lightning
LMArena Math12721300

Knowledge Yi-Lightning leads

Gemini Advanced 0514: 32.7 (#201), Yi-Lightning: 34.8 (#182)

Knowledge benchmarks
BenchmarkGemini Advanced 0514Yi-Lightning
LMArena Expert12151286

Multilingual Too close to call

Gemini Advanced 0514: 42.8 (#187), Yi-Lightning: 42.4 (#191)

Multilingual benchmarks
BenchmarkGemini Advanced 0514Yi-Lightning
LMArena Non-English12741269
LMArena Chinese12741320
LMArena French13061304
LMArena German12751267
LMArena Japanese12421228
LMArena Korean12321192
LMArena Russian12831255
LMArena Spanish12421315

Instruction Following Yi-Lightning leads

Gemini Advanced 0514: 66.2 (#206), Yi-Lightning: 67.6 (#191)

Instruction Following benchmarks
BenchmarkGemini Advanced 0514Yi-Lightning
LMArena Instruction Following12541278

Long Context Yi-Lightning leads

Gemini Advanced 0514: 38.0 (#202), Yi-Lightning: 39.4 (#176)

Long Context benchmarks
BenchmarkGemini Advanced 0514Yi-Lightning
LMArena Longer Query12541297

Writing & Preference Yi-Lightning leads

Gemini Advanced 0514: 48.8 (#195), Yi-Lightning: 50.4 (#178)

Writing & Preference benchmarks
BenchmarkGemini Advanced 0514Yi-Lightning
LMArena Text12791302
LMArena Creative Writing12841280
LMArena Multi-Turn12691311

Frequently asked questions

Is Gemini Advanced 0514 better than Yi-Lightning?

Gemini Advanced 0514 and Yi-Lightning score almost the same on the Noometry Index (37.1 vs 36.5), so choose on price, context window or the category you care about most.

Is Gemini Advanced 0514 or Yi-Lightning better for coding?

Gemini Advanced 0514 scores higher on coding benchmarks: 36.0 versus 27.0 in the Noometry coding category.

How many benchmarks do Gemini Advanced 0514 and Yi-Lightning share?

17 benchmarks have published results for both models. Gemini Advanced 0514 has 17 scored results on Noometry and Yi-Lightning has 18.

Related comparisons

Go deeper