Model comparison

Amazon Nova Experimental Chat 26 02 10 vs Gemini 2.5 Flash

Amazon Nova Experimental Chat 26 02 10 is the stronger model overall, scoring 43.8 to 39.0 on the Noometry Index.

Last verified . 12 shared benchmarks.

Gemini 2.5 Flash Google

39.0

Rank #162 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Amazon Nova Experimental Chat 26 02 10 scores higher in 5 categories and Gemini 2.5 Flash in 3 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Amazon Nova Experimental Chat 26 02 10 leads 28.9 to 18.2.

Side by side

Amazon Nova Experimental Chat 26 02 10 and Gemini 2.5 Flash specifications
Amazon Nova Experimental Chat 26 02 10Gemini 2.5 Flash
ProviderAmazonGoogle
Noometry Index43.839.0
Released—2025-04-17
WeightsProprietaryProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$0.30
Output $ / M tokens—$2.50
Results tracked1254

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 43.2 (#81), Gemini 2.5 Flash: 35.5 (#210)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.5 Flash
LMArena Coding14831424
SWE-bench Verified (bash only)—28.7%
Aider Polyglot—55.1%
WeirdML—41.9%
ALE-Bench—661.88

Agentic & Tool Use Not comparable

Amazon Nova Experimental Chat 26 02 10: —, Gemini 2.5 Flash: 30.6 (#67)

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.5 Flash
Terminal-Bench—17.1%
Berkeley Function Calling Leaderboard—56.2%
TheAgentCompany—41.1%
BALROG—33.5%
Vending-Bench 2—548.84

Reasoning Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 28.9 (#84), Gemini 2.5 Flash: 18.2 (#271)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.5 Flash
LMArena Hard Prompts14581422
ARC-AGI-2—2.5%
SimpleBench—41.2%
Kagi LLM Benchmark—56.8%
ARC-AGI-1—33.3%
CritPt—1.1%
EnigmaEval—2.7%
DTBench—76.5%
LMCA—27.5%
Epoch Capabilities Index—143.04
ForecastBench—60.6

Math Gemini 2.5 Flash leads

Amazon Nova Experimental Chat 26 02 10: 36.6 (#108), Gemini 2.5 Flash: 38.1 (#87)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.5 Flash
LMArena Math14401415
OTIS Mock AIME 2024-2025—73.1%
Omni-MATH—38.5%
FrontierMath (Feb 2025 set)—4.8%
FrontierMath Tier 4 (v1)—4.2%

Knowledge Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 41.6 (#98), Gemini 2.5 Flash: 36.1 (#162)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.5 Flash
LMArena Expert15051426
Humanity's Last Exam—12.1%
MMLU-Pro—63.9%
Confabulations—16.8%
Vectara Hallucination Rate—7.8%
GPQA (HELM)—39%

Multimodal Not comparable

Amazon Nova Experimental Chat 26 02 10: —, Gemini 2.5 Flash: 41.2 (#31)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.5 Flash
LMArena Vision—1254
GeoBench—76%
VPCT—46.2%
SpatialViz-Bench—36.9%

Multilingual Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 54.3 (#48), Gemini 2.5 Flash: 52.5 (#83)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.5 Flash
LMArena Non-English14351410
LMArena Chinese14651450
LMArena Russian14231415
LMArena French—1433
LMArena German—1419
LMArena Japanese—1403
LMArena Korean—1385
LMArena Spanish—1421

Instruction Following Too close to call

Amazon Nova Experimental Chat 26 02 10: 75.3 (#66), Gemini 2.5 Flash: 75.9 (#50)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.5 Flash
LMArena Instruction Following14261405
IFEval—89.8%

Long Context Gemini 2.5 Flash leads

Amazon Nova Experimental Chat 26 02 10: 44.0 (#73), Gemini 2.5 Flash: 47.5 (#16)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.5 Flash
LMArena Longer Query14411419
Fiction.LiveBench—77.8%

Writing & Preference Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 62.0 (#80), Gemini 2.5 Flash: 54.0 (#153)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.5 Flash
LMArena Text14491417
LMArena Creative Writing13691400
LMArena Multi-Turn14421408
Short-Story Creative Writing—76.5%
EQ-Bench Creative Writing—1137
WildBench—81.7%

Frequently asked questions

Is Amazon Nova Experimental Chat 26 02 10 better than Gemini 2.5 Flash?

Amazon Nova Experimental Chat 26 02 10 is the stronger model overall, scoring 43.8 to 39.0 on the Noometry Index.

Is Amazon Nova Experimental Chat 26 02 10 or Gemini 2.5 Flash better for coding?

Amazon Nova Experimental Chat 26 02 10 scores higher on coding benchmarks: 43.2 versus 35.5 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 26 02 10 and Gemini 2.5 Flash share?

12 benchmarks have published results for both models. Amazon Nova Experimental Chat 26 02 10 has 12 scored results on Noometry and Gemini 2.5 Flash has 54.

Related comparisons

Go deeper