Model comparison

Amazon Nova Experimental Chat 26 02 10 vs Gemini 2.0 Flash (Feb 2025)

Amazon Nova Experimental Chat 26 02 10 is the stronger model overall, scoring 43.8 to 34.8 on the Noometry Index.

Last verified . 12 shared benchmarks.

Summary

  • They share 12 benchmarks with published results for both. Amazon Nova Experimental Chat 26 02 10 scores higher in 8 categories and Gemini 2.0 Flash (Feb 2025) in 0 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Amazon Nova Experimental Chat 26 02 10 leads 43.2 to 28.2.

Side by side

Amazon Nova Experimental Chat 26 02 10 and Gemini 2.0 Flash (Feb 2025) specifications
Amazon Nova Experimental Chat 26 02 10Gemini 2.0 Flash (Feb 2025)
ProviderAmazonGoogle
Noometry Index43.834.8
Released—2024-12-06
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1254

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 43.2 (#81), Gemini 2.0 Flash (Feb 2025): 28.2 (#308)

Coding benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.0 Flash (Feb 2025)
LMArena Coding14831351
SWE-bench Verified (bash only)—13.5%
Aider Polyglot—38.2%
WeirdML—25.8%
BigCodeBench Instruct—45.9%
LiveBench Coding—63.4%
BigCodeBench Complete—59.9%
CadEval—30%

Agentic & Tool Use Not comparable

Amazon Nova Experimental Chat 26 02 10: —, Gemini 2.0 Flash (Feb 2025): 28.0 (#85)

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.0 Flash (Feb 2025)
TheAgentCompany—11.4%

Reasoning Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 28.9 (#84), Gemini 2.0 Flash (Feb 2025): 15.2 (#308)

Reasoning benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.0 Flash (Feb 2025)
LMArena Hard Prompts14581346
ARC-AGI-2—1.3%
SimpleBench—31.1%
Kagi LLM Benchmark—37.8%
EnigmaEval—1.1%
LiveBench Reasoning—78.2%
DTBench—63.2%
LiveBench Data Analysis—69.4%
Epoch Capabilities Index—135.36
LiveBench—66.9%

Math Too close to call

Amazon Nova Experimental Chat 26 02 10: 36.6 (#108), Gemini 2.0 Flash (Feb 2025): 36.1 (#127)

Math benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.0 Flash (Feb 2025)
LMArena Math14401351
OTIS Mock AIME 2024-2025—57.8%
Omni-MATH—45.9%
LiveBench Math—75.8%
MATH Level 5—82.2%
FrontierMath (Feb 2025 set)—1.7%

Knowledge Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 41.6 (#98), Gemini 2.0 Flash (Feb 2025): 32.0 (#207)

Knowledge benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.0 Flash (Feb 2025)
LMArena Expert15051340
GPQA Diamond—64.1%
Humanity's Last Exam—6.6%
MMLU-Pro—73.7%
Confabulations—12.4%
GPQA (HELM)—55.6%
MMLU—79.7%

Multimodal Not comparable

Amazon Nova Experimental Chat 26 02 10: —, Gemini 2.0 Flash (Feb 2025): 35.9 (#74)

Multimodal benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.0 Flash (Feb 2025)
LMArena Vision—1158
GeoBench—77%

Multilingual Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 54.3 (#48), Gemini 2.0 Flash (Feb 2025): 47.6 (#144)

Multilingual benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.0 Flash (Feb 2025)
LMArena Non-English14351342
LMArena Chinese14651373
LMArena Russian14231351
LMArena French—1390
LMArena German—1354
LMArena Japanese—1293
LMArena Korean—1314
LMArena Spanish—1363

Instruction Following Too close to call

Amazon Nova Experimental Chat 26 02 10: 75.3 (#66), Gemini 2.0 Flash (Feb 2025): 74.6 (#91)

Instruction Following benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.0 Flash (Feb 2025)
LMArena Instruction Following14261336
LiveBench Instruction Following—85.8%
IFEval—84.1%

Long Context Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 44.0 (#73), Gemini 2.0 Flash (Feb 2025): 38.1 (#198)

Long Context benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.0 Flash (Feb 2025)
LMArena Longer Query14411345
Fiction.LiveBench—61.1%

Writing & Preference Amazon Nova Experimental Chat 26 02 10 leads

Amazon Nova Experimental Chat 26 02 10: 62.0 (#80), Gemini 2.0 Flash (Feb 2025): 49.8 (#184)

Writing & Preference benchmarks
BenchmarkAmazon Nova Experimental Chat 26 02 10Gemini 2.0 Flash (Feb 2025)
LMArena Text14491354
LMArena Creative Writing13691340
LMArena Multi-Turn14421350
Short-Story Creative Writing—73.8%
EQ-Bench Creative Writing—1128
WildBench—80%
LiveBench Language—51.3%

Frequently asked questions

Is Amazon Nova Experimental Chat 26 02 10 better than Gemini 2.0 Flash (Feb 2025)?

Amazon Nova Experimental Chat 26 02 10 is the stronger model overall, scoring 43.8 to 34.8 on the Noometry Index.

Is Amazon Nova Experimental Chat 26 02 10 or Gemini 2.0 Flash (Feb 2025) better for coding?

Amazon Nova Experimental Chat 26 02 10 scores higher on coding benchmarks: 43.2 versus 28.2 in the Noometry coding category.

How many benchmarks do Amazon Nova Experimental Chat 26 02 10 and Gemini 2.0 Flash (Feb 2025) share?

12 benchmarks have published results for both models. Amazon Nova Experimental Chat 26 02 10 has 12 scored results on Noometry and Gemini 2.0 Flash (Feb 2025) has 54.

Related comparisons

Go deeper