Noometry

Model comparison

Claude Sonnet 5 vs Gemini 2.5 Pro

Claude Sonnet 5 is the stronger model overall, scoring 54.6 to 45.0 on the Noometry Index.

Last verified . 38 shared benchmarks.

Claude Sonnet 5 Anthropic

54.6

Rank #29 Confirmed

Gemini 2.5 Pro Google

45.0

Rank #75 Confirmed

Summary

  • They share 38 benchmarks with published results for both. Claude Sonnet 5 scores higher in 6 categories and Gemini 2.5 Pro in 4 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Sonnet 5 leads 66.2 to 32.5.
  • The biggest single-benchmark swing is FrontierMath (Tiers 1-3): 65.6% for Claude Sonnet 5 and 24.6% for Gemini 2.5 Pro.
  • Gemini 2.5 Pro is cheaper at $1.25 / $10 per million input/output tokens, against $2 / $10 for Claude Sonnet 5.
  • Gemini 2.5 Pro accepts more context: 1.05M tokens versus 1M.

Side by side

Claude Sonnet 5Gemini 2.5 Pro
ProviderAnthropicGoogle
Noometry Index54.645.0
Released2026-06-292025-03-25
WeightsProprietaryProprietary
Context window1M1.05M
Max output128K66K
Input $ / M tokens$2$1.25
Output $ / M tokens$10$10
Results tracked5178

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 5 leads

Claude Sonnet 5: 55.5 (#26), Gemini 2.5 Pro: 42.4 (#101)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
LMArena WebDev15411227
SciCode54.3%42.8%
GSO37.3%3.9%
WeirdML68.8%54%
LMArena Coding14831452
ALE-Bench1,463785.52
SWE-bench Verified—57.6%
DeepSWE53.8%—
FrontierCode42.7%—
SWE-bench Verified (bash only)—53.6%
Aider Polyglot—83.1%
CursorBench34.1%—
LiveBench Coding—85.9%
CadEval—64%
AlgoTune—1.51

Agentic & Tool Use Claude Sonnet 5 leads

Claude Sonnet 5: 42.8 (#18), Gemini 2.5 Pro: 29.2 (#88)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
LMArena Search11941142
Vending-Bench 26,378573.64
Terminal-Bench—32.6%
APEX-Agents54.5%—
GDPval—23.3%
Remote Labor Index—0.8%
TheAgentCompany—30.3%
τ²-bench Banking—13.7%
DeepResearch Bench—42.8%
BALROG—43.3%
GBAEval65.3%—
METR Time Horizons—55.4%

Reasoning Claude Sonnet 5 leads

Claude Sonnet 5: 49.1 (#39), Gemini 2.5 Pro: 28.8 (#99)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
SimpleBench60.6%62.4%
CritPt16.9%2%
Chess Puzzles35%20%
LMArena Hard Prompts14611455
DTBench92.5%82.4%
LMCA50%34.8%
Epoch Capabilities Index156.21145.32
ForecastBench61.161.3
ARC-AGI-2—4.9%
Kagi LLM Benchmark—70.3%
NYT Connections (extended)75.1%—
ARC-AGI-1—41%
EnigmaEval—5.6%
LiveBench Reasoning—89.8%
Mystery Game Puzzles35%—
LiveBench Data Analysis—79.9%
Surface Evolver Bench60%—
Bench to the Future 30.14—
LiveBench—82.3%

Math Claude Sonnet 5 leads

Claude Sonnet 5: 66.2 (#27), Gemini 2.5 Pro: 32.5 (#213)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
FrontierMath (Tiers 1-3)65.6%24.6%
FrontierMath Tier 429.3%0%
OTIS Mock AIME 2024-202594.7%84.7%
LMArena Math14671450
ProofBench77%—
Omni-MATH—41.6%
LiveBench Math—90.2%
MATH Level 5—95.9%
FrontierMath (Feb 2025 set)—14.1%
FrontierMath Tier 4 (v1)—4.2%

Knowledge Too close to call

Claude Sonnet 5: 55.6 (#47), Gemini 2.5 Pro: 56.0 (#46)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
GPQA Diamond90.5%85.3%
LMArena Expert14901452
Humanity's Last Exam—21.6%
SimpleQA Verified33.7%—
MMLU-Pro—86.3%
Confabulations—10.6%
Vectara Hallucination Rate—7%
GPQA (HELM)—74.9%

Multimodal Gemini 2.5 Pro leads

Claude Sonnet 5: 42.4 (#31), Gemini 2.5 Pro: 45.2 (#18)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
LMArena Vision12741263
LMArena Document14661421
GeoBench—86%
VPCT—48%
Blueprint-Bench 224.9%—
SpatialViz-Bench—44.7%

Multilingual Gemini 2.5 Pro leads

Claude Sonnet 5: 53.8 (#55), Gemini 2.5 Pro: 55.3 (#31)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
LMArena Non-English14311451
LMArena Chinese14771507
LMArena French14601472
LMArena German14401487
LMArena Japanese14221461
LMArena Korean14111434
LMArena Russian14511461
LMArena Spanish14371473

Instruction Following Claude Sonnet 5 leads

Claude Sonnet 5: 76.3 (#41), Gemini 2.5 Pro: 75.0 (#75)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
LMArena Instruction Following14521437
LiveBench Instruction Following—80.6%
IFEval—84%

Long Context Gemini 2.5 Pro leads

Claude Sonnet 5: 44.8 (#55), Gemini 2.5 Pro: 59.8 (#5)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
LMArena Longer Query14631449
Fiction.LiveBench—91.7%

Writing & Preference Claude Sonnet 5 leads

Claude Sonnet 5: 69.2 (#25), Gemini 2.5 Pro: 63.7 (#62)

BenchmarkClaude Sonnet 5Gemini 2.5 Pro
LMArena Text14421458
LMArena Creative Writing14161454
EQ-Bench Creative Writing17941421
LMArena Multi-Turn14541453
Short-Story Creative Writing—83.8%
WildBench—85.7%
EQ-Bench 41236—
LiveBench Language—67.8%

Frequently asked questions

Is Claude Sonnet 5 better than Gemini 2.5 Pro?

Claude Sonnet 5 is the stronger model overall, scoring 54.6 to 45.0 on the Noometry Index.

Which is cheaper, Claude Sonnet 5 or Gemini 2.5 Pro?

Gemini 2.5 Pro is cheaper. It lists at $1.25 per million input tokens and $10 per million output tokens; Claude Sonnet 5 lists at $2 and $10.

Is Claude Sonnet 5 or Gemini 2.5 Pro better for coding?

Claude Sonnet 5 scores higher on coding benchmarks: 55.5 versus 42.4 in the Noometry coding category.

Which has the bigger context window?

Gemini 2.5 Pro does, with 1.05M tokens against 1M.

How many benchmarks do Claude Sonnet 5 and Gemini 2.5 Pro share?

38 benchmarks have published results for both models. Claude Sonnet 5 has 51 scored results on Noometry and Gemini 2.5 Pro has 78.

Related comparisons

Go deeper