Model comparison

Gemini 2.5 Flash vs Nova Premier 1.0

Gemini 2.5 Flash and Nova Premier 1.0 score almost the same on the Noometry Index (39.3 vs 38.3), so choose on price, context window or the category you care about most.

Last verified . 6 shared benchmarks.

Gemini 2.5 Flash Google

39.3

Rank #170 Confirmed

Nova Premier 1.0 Amazon

38.3

Rank #189 Confirmed

Summary

  • They share 6 benchmarks with published results for both. Gemini 2.5 Flash scores higher in 4 categories and Nova Premier 1.0 in 1 category; 4 gaps are clear of the uncertainty.
  • The widest gap is in instruction following, where Gemini 2.5 Flash leads 75.7 to 66.8.
  • The biggest single-benchmark swing is GPQA (HELM): 39% for Gemini 2.5 Flash and 51.8% for Nova Premier 1.0.
  • Gemini 2.5 Flash is cheaper at $0.30 / $2.50 per million input/output tokens, against $2.50 / $12.50 for Nova Premier 1.0.
  • Gemini 2.5 Flash accepts more context: 1.05M tokens versus 1M.

Side by side

Gemini 2.5 Flash and Nova Premier 1.0 specifications
Gemini 2.5 FlashNova Premier 1.0
ProviderGoogleAmazon
Noometry Index39.338.3
Released2025-04-172025-04-30
WeightsProprietaryProprietary
Context window1.05M1M
Max output66K10K
Input $ / M tokens$0.30$2.50
Output $ / M tokens$2.50$12.50
Results tracked546

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemini 2.5 Flash: 35.8 (#220), Nova Premier 1.0: —

Coding benchmarks
BenchmarkGemini 2.5 FlashNova Premier 1.0
SWE-bench Verified (bash only)28.7%—
Aider Polyglot55.1%—
WeirdML41.9%—
LMArena Coding1424—
ALE-Bench661.88—

Agentic & Tool Use Not comparable

Gemini 2.5 Flash: 30.8 (#74), Nova Premier 1.0: —

Agentic & Tool Use benchmarks
BenchmarkGemini 2.5 FlashNova Premier 1.0
Terminal-Bench17.1%—
Berkeley Function Calling Leaderboard56.2%—
TheAgentCompany41.1%—
BALROG33.5%—
Vending-Bench 2548.84—

Reasoning Nova Premier 1.0 leads

Gemini 2.5 Flash: 18.1 (#286), Nova Premier 1.0: 23.0 (#185)

Reasoning benchmarks
BenchmarkGemini 2.5 FlashNova Premier 1.0
Kagi LLM Benchmark56.8%44.8%
ARC-AGI-22.5%—
SimpleBench41.2%—
ARC-AGI-133.3%—
CritPt1.1%—
EnigmaEval2.7%—
LMArena Hard Prompts1422—
DTBench76.5%—
LMCA27.5%—
Epoch Capabilities Index143.03—
ForecastBench60.6—

Math Gemini 2.5 Flash leads

Gemini 2.5 Flash: 39.9 (#98), Nova Premier 1.0: 33.8 (#199)

Math benchmarks
BenchmarkGemini 2.5 FlashNova Premier 1.0
Omni-MATH38.5%35%
OTIS Mock AIME 2024-202573.1%—
LMArena Math1415—
FrontierMath (Feb 2025 set)4.8%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Too close to call

Gemini 2.5 Flash: 36.4 (#168), Nova Premier 1.0: 35.8 (#180)

Knowledge benchmarks
BenchmarkGemini 2.5 FlashNova Premier 1.0
MMLU-Pro63.9%72.6%
GPQA (HELM)39%51.8%
Humanity's Last Exam12.1%—
Confabulations16.8%—
Vectara Hallucination Rate7.8%—
LMArena Expert1426—

Multimodal Not comparable

Gemini 2.5 Flash: 41.8 (#32), Nova Premier 1.0: —

Multimodal benchmarks
BenchmarkGemini 2.5 FlashNova Premier 1.0
LMArena Vision1253—
GeoBench76%—
VPCT46.2%—
SpatialViz-Bench36.9%—

Multilingual Not comparable

Gemini 2.5 Flash: 52.3 (#88), Nova Premier 1.0: —

Multilingual benchmarks
BenchmarkGemini 2.5 FlashNova Premier 1.0
LMArena Non-English1409—
LMArena Chinese1450—
LMArena French1433—
LMArena German1418—
LMArena Japanese1405—
LMArena Korean1385—
LMArena Russian1415—
LMArena Spanish1421—

Instruction Following Gemini 2.5 Flash leads

Gemini 2.5 Flash: 75.7 (#54), Nova Premier 1.0: 66.8 (#204)

Instruction Following benchmarks
BenchmarkGemini 2.5 FlashNova Premier 1.0
IFEval89.8%80.3%
LMArena Instruction Following1405—

Long Context Not comparable

Gemini 2.5 Flash: 47.5 (#17), Nova Premier 1.0: —

Long Context benchmarks
BenchmarkGemini 2.5 FlashNova Premier 1.0
Fiction.LiveBench77.8%—
LMArena Longer Query1419—

Writing & Preference Gemini 2.5 Flash leads

Gemini 2.5 Flash: 53.8 (#157), Nova Premier 1.0: 51.0 (#178)

Writing & Preference benchmarks
BenchmarkGemini 2.5 FlashNova Premier 1.0
WildBench81.7%78.8%
LMArena Text1417—
LMArena Creative Writing1400—
Short-Story Creative Writing76.5%—
EQ-Bench Creative Writing1137—
LMArena Multi-Turn1408—

Frequently asked questions

Is Gemini 2.5 Flash better than Nova Premier 1.0?

Gemini 2.5 Flash and Nova Premier 1.0 score almost the same on the Noometry Index (39.3 vs 38.3), so choose on price, context window or the category you care about most.

Which is cheaper, Gemini 2.5 Flash or Nova Premier 1.0?

Gemini 2.5 Flash is cheaper. It lists at $0.30 per million input tokens and $2.50 per million output tokens; Nova Premier 1.0 lists at $2.50 and $12.50.

Which has the bigger context window?

Gemini 2.5 Flash does, with 1.05M tokens against 1M.

How many benchmarks do Gemini 2.5 Flash and Nova Premier 1.0 share?

6 benchmarks have published results for both models. Gemini 2.5 Flash has 54 scored results on Noometry and Nova Premier 1.0 has 6.

Related comparisons

Go deeper