Noometry

Model comparison

Gemini 2.5 Flash vs Gemini 2.5 Pro

Gemini 2.5 Pro is the stronger model overall, scoring 45.0 to 39.3 on the Noometry Index. Gemini 2.5 Flash costs 4.0× less per token, which makes it the better buy when Gemini 2.5 Pro's lead doesn't matter for your workload.

Last verified . 53 shared benchmarks.

Gemini 2.5 Flash Google

39.3

Rank #170 Confirmed

Gemini 2.5 Pro Google

45.0

Rank #75 Confirmed

Summary

  • They share 53 benchmarks with published results for both. Gemini 2.5 Flash scores higher in 3 categories and Gemini 2.5 Pro in 7 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 2.5 Pro leads 56.0 to 36.4.
  • The biggest single-benchmark swing is GPQA (HELM): 39% for Gemini 2.5 Flash and 74.9% for Gemini 2.5 Pro.
  • Gemini 2.5 Flash is cheaper at $0.30 / $2.50 per million input/output tokens, against $1.25 / $10 for Gemini 2.5 Pro.

Side by side

Gemini 2.5 FlashGemini 2.5 Pro
ProviderGoogleGoogle
Noometry Index39.345.0
Released2025-04-172025-03-25
WeightsProprietaryProprietary
Context window1.05M1.05M
Max output66K66K
Input $ / M tokens$0.30$1.25
Output $ / M tokens$2.50$10
Results tracked5478

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.5 Pro leads

Gemini 2.5 Flash: 35.8 (#220), Gemini 2.5 Pro: 42.4 (#101)

BenchmarkGemini 2.5 FlashGemini 2.5 Pro
SWE-bench Verified (bash only)28.7%53.6%
Aider Polyglot55.1%83.1%
WeirdML41.9%54%
LMArena Coding14241452
ALE-Bench661.88785.52
SWE-bench Verified—57.6%
LMArena WebDev—1227
SciCode—42.8%
GSO—3.9%
LiveBench Coding—85.9%
CadEval—64%
AlgoTune—1.51

Agentic & Tool Use Gemini 2.5 Flash leads

Gemini 2.5 Flash: 30.8 (#74), Gemini 2.5 Pro: 29.2 (#88)

BenchmarkGemini 2.5 FlashGemini 2.5 Pro
Terminal-Bench17.1%32.6%
TheAgentCompany41.1%30.3%
BALROG33.5%43.3%
Vending-Bench 2548.84573.64
Berkeley Function Calling Leaderboard56.2%—
GDPval—23.3%
Remote Labor Index—0.8%
τ²-bench Banking—13.7%
DeepResearch Bench—42.8%
LMArena Search—1142
METR Time Horizons—55.4%

Reasoning Gemini 2.5 Pro leads

Gemini 2.5 Flash: 18.1 (#286), Gemini 2.5 Pro: 28.8 (#99)

BenchmarkGemini 2.5 FlashGemini 2.5 Pro
ARC-AGI-22.5%4.9%
SimpleBench41.2%62.4%
Kagi LLM Benchmark56.8%70.3%
ARC-AGI-133.3%41%
CritPt1.1%2%
EnigmaEval2.7%5.6%
LMArena Hard Prompts14221455
DTBench76.5%82.4%
LMCA27.5%34.8%
Epoch Capabilities Index143.03145.32
ForecastBench60.661.3
Chess Puzzles—20%
LiveBench Reasoning—89.8%
LiveBench Data Analysis—79.9%
LiveBench—82.3%

Math Gemini 2.5 Flash leads

Gemini 2.5 Flash: 39.9 (#98), Gemini 2.5 Pro: 32.5 (#213)

BenchmarkGemini 2.5 FlashGemini 2.5 Pro
OTIS Mock AIME 2024-202573.1%84.7%
Omni-MATH38.5%41.6%
LMArena Math14151450
FrontierMath (Feb 2025 set)4.8%14.1%
FrontierMath Tier 4 (v1)4.2%4.2%
FrontierMath (Tiers 1-3)—24.6%
FrontierMath Tier 4—0%
LiveBench Math—90.2%
MATH Level 5—95.9%

Knowledge Gemini 2.5 Pro leads

Gemini 2.5 Flash: 36.4 (#168), Gemini 2.5 Pro: 56.0 (#46)

BenchmarkGemini 2.5 FlashGemini 2.5 Pro
Humanity's Last Exam12.1%21.6%
MMLU-Pro63.9%86.3%
Confabulations16.8%10.6%
Vectara Hallucination Rate7.8%7%
GPQA (HELM)39%74.9%
LMArena Expert14261452
GPQA Diamond—85.3%

Multimodal Gemini 2.5 Pro leads

Gemini 2.5 Flash: 41.8 (#32), Gemini 2.5 Pro: 45.2 (#18)

BenchmarkGemini 2.5 FlashGemini 2.5 Pro
LMArena Vision12531263
GeoBench76%86%
VPCT46.2%48%
SpatialViz-Bench36.9%44.7%
LMArena Document—1421

Multilingual Gemini 2.5 Pro leads

Gemini 2.5 Flash: 52.3 (#88), Gemini 2.5 Pro: 55.3 (#31)

BenchmarkGemini 2.5 FlashGemini 2.5 Pro
LMArena Non-English14091451
LMArena Chinese14501507
LMArena French14331472
LMArena German14181487
LMArena Japanese14051461
LMArena Korean13851434
LMArena Russian14151461
LMArena Spanish14211473

Instruction Following Too close to call

Gemini 2.5 Flash: 75.7 (#54), Gemini 2.5 Pro: 75.0 (#75)

BenchmarkGemini 2.5 FlashGemini 2.5 Pro
IFEval89.8%84%
LMArena Instruction Following14051437
LiveBench Instruction Following—80.6%

Long Context Gemini 2.5 Pro leads

Gemini 2.5 Flash: 47.5 (#17), Gemini 2.5 Pro: 59.8 (#5)

BenchmarkGemini 2.5 FlashGemini 2.5 Pro
Fiction.LiveBench77.8%91.7%
LMArena Longer Query14191449

Writing & Preference Gemini 2.5 Pro leads

Gemini 2.5 Flash: 53.8 (#157), Gemini 2.5 Pro: 63.7 (#62)

BenchmarkGemini 2.5 FlashGemini 2.5 Pro
LMArena Text14171458
LMArena Creative Writing14001454
Short-Story Creative Writing76.5%83.8%
EQ-Bench Creative Writing11371421
WildBench81.7%85.7%
LMArena Multi-Turn14081453
LiveBench Language—67.8%

Frequently asked questions

Is Gemini 2.5 Flash better than Gemini 2.5 Pro?

Gemini 2.5 Pro is the stronger model overall, scoring 45.0 to 39.3 on the Noometry Index. Gemini 2.5 Flash costs 4.0× less per token, which makes it the better buy when Gemini 2.5 Pro's lead doesn't matter for your workload.

Which is cheaper, Gemini 2.5 Flash or Gemini 2.5 Pro?

Gemini 2.5 Flash is cheaper. It lists at $0.30 per million input tokens and $2.50 per million output tokens; Gemini 2.5 Pro lists at $1.25 and $10.

Is Gemini 2.5 Flash or Gemini 2.5 Pro better for coding?

Gemini 2.5 Pro scores higher on coding benchmarks: 42.4 versus 35.8 in the Noometry coding category.

Which has the bigger context window?

Both accept 1.05M tokens.

How many benchmarks do Gemini 2.5 Flash and Gemini 2.5 Pro share?

53 benchmarks have published results for both models. Gemini 2.5 Flash has 54 scored results on Noometry and Gemini 2.5 Pro has 78.

Related comparisons

Go deeper