Noometry

Model comparison

Gemini 2.5 Flash-Lite vs Mercury

Gemini 2.5 Flash-Lite and Mercury score almost the same on the Noometry Index (37.0 vs 37.6), so choose on price, context window or the category you care about most.

Last verified . 9 shared benchmarks.

Gemini 2.5 Flash-Lite Google

37.0

Rank #211 Confirmed

Mercury Inception

37.6

Rank #199 Confirmed

Summary

  • They share 9 benchmarks with published results for both. Gemini 2.5 Flash-Lite scores higher in 4 categories and Mercury in 2 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemini 2.5 Flash-Lite leads 56.8 to 46.2.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 40.5% for Gemini 2.5 Flash-Lite and 21.6% for Mercury.

Side by side

Gemini 2.5 Flash-LiteMercury
ProviderGoogleInception
Noometry Index37.037.6
Released2025-06-17—
WeightsProprietaryProprietary
Context window1.05M—
Max output66K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.40—
Results tracked339

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Gemini 2.5 Flash-Lite: 38.5 (#173), Mercury: 38.7 (#170)

BenchmarkGemini 2.5 Flash-LiteMercury
LMArena Coding13731322
WeirdML35.2%—
ALE-Bench325.9—

Agentic & Tool Use Not comparable

Gemini 2.5 Flash-Lite: 28.0 (#96), Mercury: —

BenchmarkGemini 2.5 Flash-LiteMercury
Berkeley Function Calling Leaderboard36.9%—

Reasoning Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 22.2 (#205), Mercury: 17.5 (#293)

BenchmarkGemini 2.5 Flash-LiteMercury
Kagi LLM Benchmark40.5%21.6%
LMArena Hard Prompts13771285
DTBench62.8%—
LMCA18.1%—
Epoch Capabilities Index133.94—

Math Not comparable

Gemini 2.5 Flash-Lite: 38.0 (#144), Mercury: —

BenchmarkGemini 2.5 Flash-LiteMercury
Omni-MATH48%—
LMArena Math1373—

Knowledge Not comparable

Gemini 2.5 Flash-Lite: 32.5 (#210), Mercury: —

BenchmarkGemini 2.5 Flash-LiteMercury
MMLU-Pro53.7%—
Vectara Hallucination Rate3.3%—
GPQA (HELM)30.9%—
LMArena Expert1373—

Multimodal Not comparable

Gemini 2.5 Flash-Lite: 29.1 (#114), Mercury: —

BenchmarkGemini 2.5 Flash-LiteMercury
LMArena Vision1198—
VPCT30%—

Multilingual Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 49.3 (#134), Mercury: 41.6 (#206)

BenchmarkGemini 2.5 Flash-LiteMercury
LMArena Non-English13691260
LMArena Chinese1404—
LMArena French1388—
LMArena German1389—
LMArena Japanese1359—
LMArena Korean1360—
LMArena Russian1373—
LMArena Spanish1396—

Instruction Following Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 70.0 (#168), Mercury: 65.2 (#224)

BenchmarkGemini 2.5 Flash-LiteMercury
LMArena Instruction Following13671239
IFEval81%—

Long Context Mercury leads

Gemini 2.5 Flash-Lite: 33.3 (#262), Mercury: 38.4 (#198)

BenchmarkGemini 2.5 Flash-LiteMercury
LMArena Longer Query13731266
Fiction.LiveBench47.2%—

Writing & Preference Gemini 2.5 Flash-Lite leads

Gemini 2.5 Flash-Lite: 56.8 (#135), Mercury: 46.2 (#221)

BenchmarkGemini 2.5 Flash-LiteMercury
LMArena Text13791282
LMArena Creative Writing13671191
LMArena Multi-Turn13661282
WildBench81.8%—

Frequently asked questions

Is Gemini 2.5 Flash-Lite better than Mercury?

Gemini 2.5 Flash-Lite and Mercury score almost the same on the Noometry Index (37.0 vs 37.6), so choose on price, context window or the category you care about most.

Is Gemini 2.5 Flash-Lite or Mercury better for coding?

They score almost the same on coding (38.5 vs 38.7); test both on your own repository before choosing.

How many benchmarks do Gemini 2.5 Flash-Lite and Mercury share?

9 benchmarks have published results for both models. Gemini 2.5 Flash-Lite has 33 scored results on Noometry and Mercury has 9.

Related comparisons

Go deeper