Model comparison

Gemini 1.5 Flash (May 2024) vs Nova 2 Lite

Nova 2 Lite is the stronger model overall, scoring 39.7 to 33.2 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemini 1.5 Flash (May 2024) Google

33.2

Rank #246 Confirmed

Nova 2 Lite Amazon

39.7

Rank #161 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemini 1.5 Flash (May 2024) scores higher in 1 category and Nova 2 Lite in 8 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Nova 2 Lite leads 43.0 to 26.2.

Side by side

Gemini 1.5 Flash (May 2024) and Nova 2 Lite specifications
Gemini 1.5 Flash (May 2024)Nova 2 Lite
ProviderGoogleAmazon
Noometry Index33.239.7
Released2024-05-142025-12-01
WeightsProprietaryProprietary
Context window—1M
Max output—64K
Input $ / M tokens—$0.30
Output $ / M tokens—$2.50
Results tracked4219

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nova 2 Lite leads

Gemini 1.5 Flash (May 2024): 34.4 (#236), Nova 2 Lite: 40.7 (#134)

Coding benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Nova 2 Lite
LMArena Coding12611385
WeirdML24.9%—
BigCodeBench Instruct43.5%—
BigCodeBench Complete55.1%—
HumanEval+75.6%—
MBPP+67.5%—

Agentic & Tool Use Gemini 1.5 Flash (May 2024) leads

Gemini 1.5 Flash (May 2024): 26.6 (#102), Nova 2 Lite: 24.1 (#121)

Agentic & Tool Use benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Nova 2 Lite
Berkeley Function Calling Leaderboard—27.1%
BALROG14.6%—

Reasoning Nova 2 Lite leads

Gemini 1.5 Flash (May 2024): 21.7 (#215), Nova 2 Lite: 27.5 (#118)

Reasoning benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Nova 2 Lite
LMArena Hard Prompts12571364
DTBench53.8%—
Epoch Capabilities Index129.36—
ForecastBench53.9—
PIQA87.5%—

Math Nova 2 Lite leads

Gemini 1.5 Flash (May 2024): 22.1 (#281), Nova 2 Lite: 37.5 (#156)

Math benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Nova 2 Lite
LMArena Math12691359
OTIS Mock AIME 2024-202516.3%—
Omni-MATH30.4%—
MATH Level 561.9%—
FrontierMath (Feb 2025 set)0%—
GSM8K82.4%—

Knowledge Nova 2 Lite leads

Gemini 1.5 Flash (May 2024): 26.2 (#260), Nova 2 Lite: 43.0 (#94)

Knowledge benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Nova 2 Lite
LMArena Expert12331358
GPQA Diamond47.3%—
MMLU-Pro67.8%—
Vectara Hallucination Rate—5.1%
GPQA (HELM)43.7%—
BoolQ85.8%—
MMLU77.9%—

Multimodal Not comparable

Gemini 1.5 Flash (May 2024): 36.0 (#81), Nova 2 Lite: —

Multimodal benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Nova 2 Lite
LMArena Vision1141—
Video-MME70.3%—
GeoBench76%—

Multilingual Nova 2 Lite leads

Gemini 1.5 Flash (May 2024): 42.9 (#189), Nova 2 Lite: 47.1 (#153)

Multilingual benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Nova 2 Lite
LMArena Non-English12781337
LMArena Chinese12951364
LMArena French12581381
LMArena German12621343
LMArena Japanese12521271
LMArena Korean12211284
LMArena Russian12881343
LMArena Spanish12431373

Instruction Following Nova 2 Lite leads

Gemini 1.5 Flash (May 2024): 66.8 (#205), Nova 2 Lite: 70.5 (#161)

Instruction Following benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Nova 2 Lite
LMArena Instruction Following12581335
IFEval83.1%—

Long Context Nova 2 Lite leads

Gemini 1.5 Flash (May 2024): 39.0 (#187), Nova 2 Lite: 40.6 (#150)

Long Context benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Nova 2 Lite
LMArena Longer Query12841335

Writing & Preference Nova 2 Lite leads

Gemini 1.5 Flash (May 2024): 48.7 (#196), Nova 2 Lite: 53.9 (#154)

Writing & Preference benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Nova 2 Lite
LMArena Text12871362
LMArena Creative Writing12851291
LMArena Multi-Turn12531338
WildBench79.2%—

Frequently asked questions

Is Gemini 1.5 Flash (May 2024) better than Nova 2 Lite?

Nova 2 Lite is the stronger model overall, scoring 39.7 to 33.2 on the Noometry Index.

Is Gemini 1.5 Flash (May 2024) or Nova 2 Lite better for coding?

Nova 2 Lite scores higher on coding benchmarks: 40.7 versus 34.4 in the Noometry coding category.

How many benchmarks do Gemini 1.5 Flash (May 2024) and Nova 2 Lite share?

17 benchmarks have published results for both models. Gemini 1.5 Flash (May 2024) has 42 scored results on Noometry and Nova 2 Lite has 19.

Related comparisons

Go deeper