Model comparison

Gemini 3 Pro vs Mercury 2.5

Gemini 3 Pro is the stronger model overall, scoring 54.8 to 33.5 on the Noometry Index.

Last verified . 3 shared benchmarks.

Gemini 3 Pro Google

54.8

Rank #28 Confirmed

Mercury 2.5 Inception

33.5

Rank #242 Reported

Summary

  • They share 3 benchmarks with published results for both. Gemini 3 Pro scores higher in 3 categories and Mercury 2.5 in 0 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3 Pro leads 52.5 to 22.4.
  • The biggest single-benchmark swing is ProofBench: 20% for Gemini 3 Pro and 3% for Mercury 2.5.

Side by side

Gemini 3 Pro and Mercury 2.5 specifications
Gemini 3 ProMercury 2.5
ProviderGoogleInception
Noometry Index54.833.5
Released2025-11-182026-09-08
WeightsProprietaryProprietary
Context window—260K
Max output—66K
Input $ / M tokens—$0.04
Output $ / M tokens—$0.15
Results tracked674

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3 Pro leads

Gemini 3 Pro: 51.6 (#39), Mercury 2.5: 39.5 (#156)

Coding benchmarks
BenchmarkGemini 3 ProMercury 2.5
ALE-Bench1,177301.65
SWE-bench Verified72.9%—
SWE-bench Verified (bash only)74.2%—
LMArena WebDev1440—
SWE-bench Multilingual68.7%—
SciCode—38.5%
GSO18.6%—
WeirdML69.9%—
LMArena Coding1481—
AlgoTune1.83—

Agentic & Tool Use Not comparable

Gemini 3 Pro: 40.6 (#23), Mercury 2.5: —

Agentic & Tool Use benchmarks
BenchmarkGemini 3 ProMercury 2.5
Terminal-Bench69.4%—
Berkeley Function Calling Leaderboard72.5%—
GDPval40.3%—
Remote Labor Index1.3%—
τ²-bench Airline80.5%—
τ²-bench Banking18%—
τ²-bench Retail75.9%—
τ²-bench Telecom91%—
DeepResearch Bench46.3%—
BALROG58.1%—
LMArena Search1207—
METR Time Horizons71%—
Vending-Bench 25,478—

Reasoning Gemini 3 Pro leads

Gemini 3 Pro: 52.5 (#31), Mercury 2.5: 22.4 (#193)

Reasoning benchmarks
BenchmarkGemini 3 ProMercury 2.5
CritPt6.9%0%
ARC-AGI-231.1%—
SimpleBench76.4%—
Kagi LLM Benchmark80.1%—
NYT Connections (extended)94.4%—
ARC-AGI-175%—
Chess Puzzles31%—
EnigmaEval18.2%—
LMArena Hard Prompts1480—
Epoch Capabilities Index152.92—
ForecastBench61.2—

Math Gemini 3 Pro leads

Gemini 3 Pro: 49.9 (#59), Mercury 2.5: 23.3 (#272)

Math benchmarks
BenchmarkGemini 3 ProMercury 2.5
ProofBench20%3%
MathArena Final-Answer Competitions67%—
OTIS Mock AIME 2024-202591.4%—
Omni-MATH55.5%—
LMArena Math1476—
FrontierMath (Feb 2025 set)37.6%—
FrontierMath Tier 4 (v1)18.8%—

Knowledge Not comparable

Gemini 3 Pro: 64.4 (#16), Mercury 2.5: —

Knowledge benchmarks
BenchmarkGemini 3 ProMercury 2.5
GPQA Diamond92.6%—
Humanity's Last Exam37.5%—
MMLU-Pro90.3%—
Vectara Hallucination Rate13.6%—
GPQA (HELM)80.3%—
LMArena Expert1475—

Multimodal Not comparable

Gemini 3 Pro: 57.6 (#2), Mercury 2.5: —

Multimodal benchmarks
BenchmarkGemini 3 ProMercury 2.5
LMArena Vision1305—
GeoBench84%—
VPCT91%—
LMArena Document1434—

Multilingual Not comparable

Gemini 3 Pro: 56.9 (#16), Mercury 2.5: —

Multilingual benchmarks
BenchmarkGemini 3 ProMercury 2.5
LMArena Non-English1474—
LMArena Chinese1523—
LMArena French1492—
LMArena German1515—
LMArena Japanese1510—
LMArena Korean1448—
LMArena Russian1493—
LMArena Spanish1470—

Instruction Following Not comparable

Gemini 3 Pro: 76.3 (#45), Mercury 2.5: —

Instruction Following benchmarks
BenchmarkGemini 3 ProMercury 2.5
IFEval87.7%—
LMArena Instruction Following1458—

Long Context Not comparable

Gemini 3 Pro: 44.0 (#79), Mercury 2.5: —

Long Context benchmarks
BenchmarkGemini 3 ProMercury 2.5
CL-bench15.8%—
LMArena Longer Query1471—

Writing & Preference Not comparable

Gemini 3 Pro: 66.4 (#35), Mercury 2.5: —

Writing & Preference benchmarks
BenchmarkGemini 3 ProMercury 2.5
LMArena Text1479—
LMArena Creative Writing1482—
EQ-Bench Creative Writing1525—
WildBench85.9%—
LMArena Multi-Turn1484—

Frequently asked questions

Is Gemini 3 Pro better than Mercury 2.5?

Gemini 3 Pro is the stronger model overall, scoring 54.8 to 33.5 on the Noometry Index.

Is Gemini 3 Pro or Mercury 2.5 better for coding?

Gemini 3 Pro scores higher on coding benchmarks: 51.6 versus 39.5 in the Noometry coding category.

How many benchmarks do Gemini 3 Pro and Mercury 2.5 share?

3 benchmarks have published results for both models. Gemini 3 Pro has 67 scored results on Noometry and Mercury 2.5 has 4.

Related comparisons

Go deeper