Noometry

Model comparison

Gemini 2.5 Pro vs Gemini 3 Flash Preview

Gemini 3 Flash Preview is the stronger model overall, scoring 52.3 to 45.0 on the Noometry Index.

Last verified . 48 shared benchmarks.

Gemini 2.5 Pro Google

45.0

Rank #75 Confirmed

Gemini 3 Flash Preview Google

52.3

Rank #40 Confirmed

Summary

  • They share 48 benchmarks with published results for both. Gemini 2.5 Pro scores higher in 1 category and Gemini 3 Flash Preview in 9 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3 Flash Preview leads 49.2 to 28.8.
  • The biggest single-benchmark swing is ARC-AGI-1: 41% for Gemini 2.5 Pro and 84.7% for Gemini 3 Flash Preview.
  • Gemini 3 Flash Preview is cheaper at $0.50 / $3 per million input/output tokens, against $1.25 / $10 for Gemini 2.5 Pro.

Side by side

Gemini 2.5 ProGemini 3 Flash Preview
ProviderGoogleGoogle
Noometry Index45.052.3
Released2025-03-252025-12-17
WeightsProprietaryProprietary
Context window1.05M1.05M
Max output66K66K
Input $ / M tokens$1.25$0.50
Output $ / M tokens$10$3
Results tracked7859

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3 Flash Preview leads

Gemini 2.5 Pro: 42.4 (#101), Gemini 3 Flash Preview: 50.9 (#42)

BenchmarkGemini 2.5 ProGemini 3 Flash Preview
SWE-bench Verified57.6%75.4%
SWE-bench Verified (bash only)53.6%75.8%
LMArena WebDev12271439
GSO3.9%9.8%
WeirdML54%61.6%
LMArena Coding14521460
ALE-Bench785.521,367
Aider Polyglot83.1%—
SWE-bench Multilingual—72.7%
SciCode42.8%—
LiveBench Coding85.9%—
CadEval64%—
AlgoTune1.51—

Agentic & Tool Use Gemini 3 Flash Preview leads

Gemini 2.5 Pro: 29.2 (#88), Gemini 3 Flash Preview: 38.7 (#29)

BenchmarkGemini 2.5 ProGemini 3 Flash Preview
Terminal-Bench32.6%64.3%
τ²-bench Banking13.7%27.3%
DeepResearch Bench42.8%49.8%
BALROG43.3%48.1%
LMArena Search11421198
Vending-Bench 2573.643,635
GDPval23.3%—
Remote Labor Index0.8%—
TheAgentCompany30.3%—
τ²-bench Airline—82.5%
τ²-bench Retail—76.8%
τ²-bench Telecom—91.2%
GDP.pdf—10%
METR Time Horizons55.4%—

Reasoning Gemini 3 Flash Preview leads

Gemini 2.5 Pro: 28.8 (#99), Gemini 3 Flash Preview: 49.2 (#37)

BenchmarkGemini 2.5 ProGemini 3 Flash Preview
ARC-AGI-24.9%33.6%
SimpleBench62.4%61.1%
ARC-AGI-141%84.7%
Chess Puzzles20%40%
LMArena Hard Prompts14551465
DTBench82.4%89.1%
LMCA34.8%43.1%
Epoch Capabilities Index145.32151.8
ForecastBench61.358.5
Kagi LLM Benchmark70.3%—
NYT Connections (extended)—83.1%
CritPt2%—
EnigmaEval5.6%—
LiveBench Reasoning89.8%—
Mystery Game Puzzles—26%
LiveBench Data Analysis79.9%—
LiveBench82.3%—

Math Gemini 3 Flash Preview leads

Gemini 2.5 Pro: 32.5 (#213), Gemini 3 Flash Preview: 51.7 (#55)

BenchmarkGemini 2.5 ProGemini 3 Flash Preview
FrontierMath (Tiers 1-3)24.6%51.2%
FrontierMath Tier 40%17.1%
OTIS Mock AIME 2024-202584.7%95.6%
LMArena Math14501473
FrontierMath (Feb 2025 set)14.1%35.6%
FrontierMath Tier 4 (v1)4.2%4.2%
MathArena Final-Answer Competitions—67.6%
ProofBench—15%
Omni-MATH41.6%—
LiveBench Math90.2%—
MATH Level 595.9%—

Knowledge Gemini 3 Flash Preview leads

Gemini 2.5 Pro: 56.0 (#46), Gemini 3 Flash Preview: 58.8 (#33)

BenchmarkGemini 2.5 ProGemini 3 Flash Preview
GPQA Diamond85.3%89.4%
Vectara Hallucination Rate7%13.5%
LMArena Expert14521462
Humanity's Last Exam21.6%—
SimpleQA Verified—66.8%
MMLU-Pro86.3%—
Confabulations10.6%—
GPQA (HELM)74.9%—

Multimodal Too close to call

Gemini 2.5 Pro: 45.2 (#18), Gemini 3 Flash Preview: 45.5 (#16)

BenchmarkGemini 2.5 ProGemini 3 Flash Preview
LMArena Vision12631285
GeoBench86%88%
VPCT48%72.6%
LMArena Document14211413
Blueprint-Bench 2—0%
SpatialViz-Bench44.7%—

Multilingual Too close to call

Gemini 2.5 Pro: 55.3 (#31), Gemini 3 Flash Preview: 55.7 (#27)

BenchmarkGemini 2.5 ProGemini 3 Flash Preview
LMArena Non-English14511458
LMArena Chinese15071511
LMArena French14721477
LMArena German14871497
LMArena Japanese14611489
LMArena Korean14341443
LMArena Russian14611480
LMArena Spanish14731469

Instruction Following Too close to call

Gemini 2.5 Pro: 75.0 (#75), Gemini 3 Flash Preview: 75.7 (#56)

BenchmarkGemini 2.5 ProGemini 3 Flash Preview
LMArena Instruction Following14371437
LiveBench Instruction Following80.6%—
IFEval84%—

Long Context Gemini 2.5 Pro leads

Gemini 2.5 Pro: 59.8 (#5), Gemini 3 Flash Preview: 44.4 (#67)

BenchmarkGemini 2.5 ProGemini 3 Flash Preview
LMArena Longer Query14491452
Fiction.LiveBench91.7%—

Writing & Preference Gemini 3 Flash Preview leads

Gemini 2.5 Pro: 63.7 (#62), Gemini 3 Flash Preview: 65.5 (#45)

BenchmarkGemini 2.5 ProGemini 3 Flash Preview
LMArena Text14581466
LMArena Creative Writing14541457
LMArena Multi-Turn14531471
Short-Story Creative Writing83.8%—
EQ-Bench Creative Writing1421—
WildBench85.7%—
LiveBench Language67.8%—

Frequently asked questions

Is Gemini 2.5 Pro better than Gemini 3 Flash Preview?

Gemini 3 Flash Preview is the stronger model overall, scoring 52.3 to 45.0 on the Noometry Index.

Which is cheaper, Gemini 2.5 Pro or Gemini 3 Flash Preview?

Gemini 3 Flash Preview is cheaper. It lists at $0.50 per million input tokens and $3 per million output tokens; Gemini 2.5 Pro lists at $1.25 and $10.

Is Gemini 2.5 Pro or Gemini 3 Flash Preview better for coding?

Gemini 3 Flash Preview scores higher on coding benchmarks: 50.9 versus 42.4 in the Noometry coding category.

Which has the bigger context window?

Both accept 1.05M tokens.

How many benchmarks do Gemini 2.5 Pro and Gemini 3 Flash Preview share?

48 benchmarks have published results for both models. Gemini 2.5 Pro has 78 scored results on Noometry and Gemini 3 Flash Preview has 59.

Related comparisons

Go deeper