Noometry

Model comparison

Gemini 2.5 Flash-Lite vs Yi-34B

Gemini 2.5 Flash-Lite is the stronger model overall, scoring 37.0 to 27.8 on the Noometry Index.

Last verified . 18 shared benchmarks.

Gemini 2.5 Flash-Lite Google

37.0

Rank #211 Confirmed

Yi-34B 01.AI

27.8

Rank #329 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Gemini 2.5 Flash-Lite scores higher in 8 categories and Yi-34B in 0 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 2.5 Flash-Lite leads 32.5 to 7.5.
  • Yi-34B has downloadable open weights; the other is API-only.

Side by side

Gemini 2.5 Flash-LiteYi-34B
ProviderGoogle01.AI
Noometry Index37.027.8
Released2025-06-172023-11-02
WeightsProprietaryOpen
Context window1.05M—
Max output66K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.40—
Results tracked3323

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 38.5 (#173), Yi-34B: 32.3 (#274)

BenchmarkGemini 2.5 Flash-LiteYi-34B
LMArena Coding13731112
WeirdML35.2%—
ALE-Bench325.9—

Agentic & Tool Use Not comparable

Gemini 2.5 Flash-Lite: 28.0 (#96), Yi-34B: —

BenchmarkGemini 2.5 Flash-LiteYi-34B
Berkeley Function Calling Leaderboard36.9%—

Reasoning Too close to call

Gemini 2.5 Flash-Lite: 22.2 (#205), Yi-34B: 21.2 (#226)

BenchmarkGemini 2.5 Flash-LiteYi-34B
LMArena Hard Prompts13771104
Epoch Capabilities Index133.94117.39
Kagi LLM Benchmark40.5%—
DTBench62.8%—
LMCA18.1%—
BIG-Bench Hard—71.7%

Math Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 38.0 (#144), Yi-34B: 21.6 (#282)

BenchmarkGemini 2.5 Flash-LiteYi-34B
LMArena Math13731114
Omni-MATH48%—
MATH Level 5—5.1%
GSM8K—76%

Knowledge Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 32.5 (#210), Yi-34B: 7.5 (#309)

BenchmarkGemini 2.5 Flash-LiteYi-34B
LMArena Expert13731061
GPQA Diamond—14.7%
MMLU-Pro53.7%—
Vectara Hallucination Rate3.3%—
GPQA (HELM)30.9%—
MMLU—76.3%

Multimodal Not comparable

Gemini 2.5 Flash-Lite: 29.1 (#114), Yi-34B: —

BenchmarkGemini 2.5 Flash-LiteYi-34B
LMArena Vision1198—
VPCT30%—

Multilingual Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 49.3 (#134), Yi-34B: 29.7 (#264)

BenchmarkGemini 2.5 Flash-LiteYi-34B
LMArena Non-English13691079
LMArena Chinese14041176
LMArena French13881081
LMArena German13891042
LMArena Japanese1359993
LMArena Korean1360959
LMArena Russian13731050
LMArena Spanish13961070

Instruction Following Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 70.0 (#168), Yi-34B: 56.2 (#274)

BenchmarkGemini 2.5 Flash-LiteYi-34B
LMArena Instruction Following13671091
IFEval81%—

Long Context Too close to call

Gemini 2.5 Flash-Lite: 33.3 (#262), Yi-34B: 33.2 (#264)

BenchmarkGemini 2.5 Flash-LiteYi-34B
LMArena Longer Query13731094
Fiction.LiveBench47.2%—

Writing & Preference Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 56.8 (#135), Yi-34B: 34.1 (#273)

BenchmarkGemini 2.5 Flash-LiteYi-34B
LMArena Text13791129
LMArena Creative Writing13671108
LMArena Multi-Turn13661113
WildBench81.8%—

Frequently asked questions

Is Gemini 2.5 Flash-Lite better than Yi-34B?

Gemini 2.5 Flash-Lite is the stronger model overall, scoring 37.0 to 27.8 on the Noometry Index.

Is Gemini 2.5 Flash-Lite or Yi-34B better for coding?

Gemini 2.5 Flash-Lite scores higher on coding benchmarks: 38.5 versus 32.3 in the Noometry coding category.

How many benchmarks do Gemini 2.5 Flash-Lite and Yi-34B share?

18 benchmarks have published results for both models. Gemini 2.5 Flash-Lite has 33 scored results on Noometry and Yi-34B has 23.

Related comparisons

Go deeper