Noometry

Model comparison

Gemini 3 Flash Preview vs Mercury 2.5

Gemini 3 Flash Preview has enough public results to be ranked (#33); Mercury 2.5 does not yet, so treat this comparison as directional.

Last verified . 2 shared benchmarks.

Gemini 3 Flash Preview Google

52.3

Rank #33 Confirmed

Mercury 2.5 Inception

30.2

Unranked Sparse

Summary

  • They share 2 benchmarks with published results for both. Gemini 3 Flash Preview scores higher in 1 category and Mercury 2.5 in 0 categories; one gap is clear of the uncertainty.
  • The widest gap is in math, where Gemini 3 Flash Preview leads 51.4 to 22.4.
  • The biggest single-benchmark swing is ProofBench: 15% for Gemini 3 Flash Preview and 3% for Mercury 2.5.
  • Mercury 2.5 is cheaper at $0.04 / $0.15 per million input/output tokens, against $0.50 / $3 for Gemini 3 Flash Preview.
  • Gemini 3 Flash Preview accepts more context: 1.05M tokens versus 260K.

Side by side

Gemini 3 Flash PreviewMercury 2.5
ProviderGoogleInception
Noometry Index52.330.2
Released2025-12-172026-09-08
WeightsProprietaryProprietary
Context window1.05M260K
Max output66K66K
Input $ / M tokens$0.50$0.04
Output $ / M tokens$3$0.15
Results tracked592

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemini 3 Flash Preview: 51.5 (#35), Mercury 2.5: —

BenchmarkGemini 3 Flash PreviewMercury 2.5
ALE-Bench1,367301.65
SWE-bench Verified75.4%—
SWE-bench Verified (bash only)75.8%—
LMArena WebDev1439—
SWE-bench Multilingual72.7%—
GSO9.8%—
WeirdML61.6%—
LMArena Coding1460—

Agentic & Tool Use Not comparable

Gemini 3 Flash Preview: 38.6 (#27), Mercury 2.5: —

BenchmarkGemini 3 Flash PreviewMercury 2.5
Terminal-Bench64.3%—
τ²-bench Airline82.5%—
τ²-bench Banking27.3%—
τ²-bench Retail76.8%—
τ²-bench Telecom91.2%—
DeepResearch Bench49.8%—
BALROG48.1%—
GDP.pdf10%—
LMArena Search1198—
Vending-Bench 23,635—

Reasoning Not comparable

Gemini 3 Flash Preview: 49.2 (#35), Mercury 2.5: —

BenchmarkGemini 3 Flash PreviewMercury 2.5
ARC-AGI-233.6%—
SimpleBench61.1%—
NYT Connections (extended)83.1%—
ARC-AGI-184.7%—
Chess Puzzles40%—
LMArena Hard Prompts1465—
Mystery Game Puzzles26%—
DTBench89.1%—
LMCA43.1%—
Epoch Capabilities Index151.83—
ForecastBench58.5—

Math Gemini 3 Flash Preview leads

Gemini 3 Flash Preview: 51.4 (#42), Mercury 2.5: 22.4

BenchmarkGemini 3 Flash PreviewMercury 2.5
ProofBench15%3%
FrontierMath (Tiers 1-3)51.2%—
FrontierMath Tier 417.1%—
MathArena Final-Answer Competitions67.6%—
OTIS Mock AIME 2024-202595.6%—
LMArena Math1472—
FrontierMath (Feb 2025 set)35.6%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Not comparable

Gemini 3 Flash Preview: 58.8 (#30), Mercury 2.5: —

BenchmarkGemini 3 Flash PreviewMercury 2.5
GPQA Diamond89.4%—
SimpleQA Verified66.8%—
Vectara Hallucination Rate13.5%—
LMArena Expert1461—

Multimodal Not comparable

Gemini 3 Flash Preview: 45.3 (#15), Mercury 2.5: —

BenchmarkGemini 3 Flash PreviewMercury 2.5
LMArena Vision1285—
GeoBench88%—
VPCT72.6%—
Blueprint-Bench 20%—
LMArena Document1413—

Multilingual Not comparable

Gemini 3 Flash Preview: 55.9 (#26), Mercury 2.5: —

BenchmarkGemini 3 Flash PreviewMercury 2.5
LMArena Non-English1458—
LMArena Chinese1510—
LMArena French1478—
LMArena German1497—
LMArena Japanese1488—
LMArena Korean1443—
LMArena Russian1480—
LMArena Spanish1470—

Instruction Following Not comparable

Gemini 3 Flash Preview: 75.8 (#52), Mercury 2.5: —

BenchmarkGemini 3 Flash PreviewMercury 2.5
LMArena Instruction Following1437—

Long Context Not comparable

Gemini 3 Flash Preview: 44.4 (#63), Mercury 2.5: —

BenchmarkGemini 3 Flash PreviewMercury 2.5
LMArena Longer Query1452—

Writing & Preference Not comparable

Gemini 3 Flash Preview: 65.6 (#44), Mercury 2.5: —

BenchmarkGemini 3 Flash PreviewMercury 2.5
LMArena Text1466—
LMArena Creative Writing1457—
LMArena Multi-Turn1471—

Frequently asked questions

Is Gemini 3 Flash Preview better than Mercury 2.5?

Gemini 3 Flash Preview has enough public results to be ranked (#33); Mercury 2.5 does not yet, so treat this comparison as directional.

Which is cheaper, Gemini 3 Flash Preview or Mercury 2.5?

Mercury 2.5 is cheaper. It lists at $0.04 per million input tokens and $0.15 per million output tokens; Gemini 3 Flash Preview lists at $0.50 and $3.

Which has the bigger context window?

Gemini 3 Flash Preview does, with 1.05M tokens against 260K.

How many benchmarks do Gemini 3 Flash Preview and Mercury 2.5 share?

2 benchmarks have published results for both models. Gemini 3 Flash Preview has 59 scored results on Noometry and Mercury 2.5 has 2.

Related comparisons

Go deeper