Noometry

Model comparison

Gemini 2.5 Flash vs Mercury

Gemini 2.5 Flash is the stronger model overall, scoring 39.3 to 37.6 on the Noometry Index.

Last verified . 9 shared benchmarks.

Gemini 2.5 Flash Google

39.3

Rank #170 Confirmed

Mercury Inception

37.6

Rank #199 Confirmed

Summary

  • They share 9 benchmarks with published results for both. Gemini 2.5 Flash scores higher in 5 categories and Mercury in 1 category; 5 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where Gemini 2.5 Flash leads 52.3 to 41.6.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 56.8% for Gemini 2.5 Flash and 21.6% for Mercury.

Side by side

Gemini 2.5 FlashMercury
ProviderGoogleInception
Noometry Index39.337.6
Released2025-04-17—
WeightsProprietaryProprietary
Context window1.05M—
Max output66K—
Input $ / M tokens$0.30—
Output $ / M tokens$2.50—
Results tracked549

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mercury leads

Gemini 2.5 Flash: 35.8 (#220), Mercury: 38.7 (#170)

BenchmarkGemini 2.5 FlashMercury
LMArena Coding14241322
SWE-bench Verified (bash only)28.7%—
Aider Polyglot55.1%—
WeirdML41.9%—
ALE-Bench661.88—

Agentic & Tool Use Not comparable

Gemini 2.5 Flash: 30.8 (#74), Mercury: —

BenchmarkGemini 2.5 FlashMercury
Terminal-Bench17.1%—
Berkeley Function Calling Leaderboard56.2%—
TheAgentCompany41.1%—
BALROG33.5%—
Vending-Bench 2548.84—

Reasoning Too close to call

Gemini 2.5 Flash: 18.1 (#286), Mercury: 17.5 (#293)

BenchmarkGemini 2.5 FlashMercury
Kagi LLM Benchmark56.8%21.6%
LMArena Hard Prompts14221285
ARC-AGI-22.5%—
SimpleBench41.2%—
ARC-AGI-133.3%—
CritPt1.1%—
EnigmaEval2.7%—
DTBench76.5%—
LMCA27.5%—
Epoch Capabilities Index143.03—
ForecastBench60.6—

Math Not comparable

Gemini 2.5 Flash: 39.9 (#98), Mercury: —

BenchmarkGemini 2.5 FlashMercury
OTIS Mock AIME 2024-202573.1%—
Omni-MATH38.5%—
LMArena Math1415—
FrontierMath (Feb 2025 set)4.8%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Not comparable

Gemini 2.5 Flash: 36.4 (#168), Mercury: —

BenchmarkGemini 2.5 FlashMercury
Humanity's Last Exam12.1%—
MMLU-Pro63.9%—
Confabulations16.8%—
Vectara Hallucination Rate7.8%—
GPQA (HELM)39%—
LMArena Expert1426—

Multimodal Not comparable

Gemini 2.5 Flash: 41.8 (#32), Mercury: —

BenchmarkGemini 2.5 FlashMercury
LMArena Vision1253—
GeoBench76%—
VPCT46.2%—
SpatialViz-Bench36.9%—

Multilingual Gemini 2.5 Flash leads

Gemini 2.5 Flash: 52.3 (#88), Mercury: 41.6 (#206)

BenchmarkGemini 2.5 FlashMercury
LMArena Non-English14091260
LMArena Chinese1450—
LMArena French1433—
LMArena German1418—
LMArena Japanese1405—
LMArena Korean1385—
LMArena Russian1415—
LMArena Spanish1421—

Instruction Following Gemini 2.5 Flash leads

Gemini 2.5 Flash: 75.7 (#54), Mercury: 65.2 (#224)

BenchmarkGemini 2.5 FlashMercury
LMArena Instruction Following14051239
IFEval89.8%—

Long Context Gemini 2.5 Flash leads

Gemini 2.5 Flash: 47.5 (#17), Mercury: 38.4 (#198)

BenchmarkGemini 2.5 FlashMercury
LMArena Longer Query14191266
Fiction.LiveBench77.8%—

Writing & Preference Gemini 2.5 Flash leads

Gemini 2.5 Flash: 53.8 (#157), Mercury: 46.2 (#221)

BenchmarkGemini 2.5 FlashMercury
LMArena Text14171282
LMArena Creative Writing14001191
LMArena Multi-Turn14081282
Short-Story Creative Writing76.5%—
EQ-Bench Creative Writing1137—
WildBench81.7%—

Frequently asked questions

Is Gemini 2.5 Flash better than Mercury?

Gemini 2.5 Flash is the stronger model overall, scoring 39.3 to 37.6 on the Noometry Index.

Is Gemini 2.5 Flash or Mercury better for coding?

Mercury scores higher on coding benchmarks: 38.7 versus 35.8 in the Noometry coding category.

How many benchmarks do Gemini 2.5 Flash and Mercury share?

9 benchmarks have published results for both models. Gemini 2.5 Flash has 54 scored results on Noometry and Mercury has 9.

Related comparisons

Go deeper