Noometry

Model comparison

Claude 3 Sonnet vs Gemini 2.0 Flash-Lite

Gemini 2.0 Flash-Lite is the stronger model overall, scoring 37.8 to 29.0 on the Noometry Index.

Last verified . 19 shared benchmarks.

Claude 3 Sonnet Anthropic

29.0

Rank #319 Confirmed

Gemini 2.0 Flash-Lite Google

37.8

Rank #194 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Claude 3 Sonnet scores higher in 0 categories and Gemini 2.0 Flash-Lite in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 2.0 Flash-Lite leads 34.1 to 10.7.

Side by side

Claude 3 SonnetGemini 2.0 Flash-Lite
ProviderAnthropicGoogle
Noometry Index29.037.8
Released2024-02-292025-02-05
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked3032

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 2.0 Flash-Lite leads

Claude 3 Sonnet: 29.6 (#302), Gemini 2.0 Flash-Lite: 37.9 (#185)

BenchmarkClaude 3 SonnetGemini 2.0 Flash-Lite
LMArena Coding12231322
WeirdML10.2%—
BigCodeBench Instruct42.7%—
LiveBench Coding—47.1%
BigCodeBench Complete53.8%—
HumanEval+64%—
MBPP+69.3%—

Reasoning Gemini 2.0 Flash-Lite leads

Claude 3 Sonnet: 20.5 (#237), Gemini 2.0 Flash-Lite: 22.0 (#210)

BenchmarkClaude 3 SonnetGemini 2.0 Flash-Lite
LMArena Hard Prompts11971324
DTBench53.6%52.5%
LiveBench Reasoning—50.1%
LiveBench Data Analysis—65.5%
Epoch Capabilities Index120.7—
ForecastBench—57.1
LiveBench—54.3%
WinoGrande75.1%—

Math Gemini 2.0 Flash-Lite leads

Claude 3 Sonnet: 10.7 (#310), Gemini 2.0 Flash-Lite: 34.1 (#196)

BenchmarkClaude 3 SonnetGemini 2.0 Flash-Lite
LMArena Math12131309
OTIS Mock AIME 2024-20252.5%—
Omni-MATH—37.4%
LiveBench Math—58.1%
MATH Level 518.2%—

Knowledge Gemini 2.0 Flash-Lite leads

Claude 3 Sonnet: 21.1 (#276), Gemini 2.0 Flash-Lite: 35.0 (#189)

BenchmarkClaude 3 SonnetGemini 2.0 Flash-Lite
LMArena Expert11731305
GPQA Diamond40.6%—
MMLU-Pro—72%
GPQA (HELM)—50%
MMLU75.9%—

Multimodal Gemini 2.0 Flash-Lite leads

Claude 3 Sonnet: 25.2 (#125), Gemini 2.0 Flash-Lite: 31.2 (#109)

BenchmarkClaude 3 SonnetGemini 2.0 Flash-Lite
LMArena Vision9841100

Multilingual Gemini 2.0 Flash-Lite leads

Claude 3 Sonnet: 37.8 (#234), Gemini 2.0 Flash-Lite: 46.0 (#161)

BenchmarkClaude 3 SonnetGemini 2.0 Flash-Lite
LMArena Non-English12051323
LMArena Chinese11891339
LMArena French12291347
LMArena German12041306
LMArena Japanese11311301
LMArena Korean11281325
LMArena Russian12271328
LMArena Spanish12041313

Instruction Following Gemini 2.0 Flash-Lite leads

Claude 3 Sonnet: 62.8 (#235), Gemini 2.0 Flash-Lite: 70.4 (#163)

BenchmarkClaude 3 SonnetGemini 2.0 Flash-Lite
LMArena Instruction Following11991305
LiveBench Instruction Following—78.3%
IFEval—82.4%

Long Context Gemini 2.0 Flash-Lite leads

Claude 3 Sonnet: 36.7 (#228), Gemini 2.0 Flash-Lite: 40.1 (#160)

BenchmarkClaude 3 SonnetGemini 2.0 Flash-Lite
LMArena Longer Query12111320

Writing & Preference Gemini 2.0 Flash-Lite leads

Claude 3 Sonnet: 42.1 (#238), Gemini 2.0 Flash-Lite: 51.7 (#177)

BenchmarkClaude 3 SonnetGemini 2.0 Flash-Lite
LMArena Text12181330
LMArena Creative Writing11861319
LMArena Multi-Turn12271307
WildBench—79%
LiveBench Language—34.3%

Frequently asked questions

Is Claude 3 Sonnet better than Gemini 2.0 Flash-Lite?

Gemini 2.0 Flash-Lite is the stronger model overall, scoring 37.8 to 29.0 on the Noometry Index.

Is Claude 3 Sonnet or Gemini 2.0 Flash-Lite better for coding?

Gemini 2.0 Flash-Lite scores higher on coding benchmarks: 37.9 versus 29.6 in the Noometry coding category.

How many benchmarks do Claude 3 Sonnet and Gemini 2.0 Flash-Lite share?

19 benchmarks have published results for both models. Claude 3 Sonnet has 30 scored results on Noometry and Gemini 2.0 Flash-Lite has 32.

Related comparisons

Go deeper