Noometry

Model comparison

Claude Opus 4 vs Gemini 3.5 Flash Lite

Claude Opus 4 is the stronger model overall, scoring 43.1 to 41.5 on the Noometry Index. Gemini 3.5 Flash Lite costs 35× less per token, which makes it the better buy when Claude Opus 4's lead doesn't matter for your workload.

Last verified . 28 shared benchmarks.

Claude Opus 4 Anthropic

43.1

Rank #100 Confirmed

Gemini 3.5 Flash Lite Google

41.5

Rank #133 Confirmed

Summary

  • They share 28 benchmarks with published results for both. Claude Opus 4 scores higher in 4 categories and Gemini 3.5 Flash Lite in 6 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Opus 4 leads 42.0 to 25.9.
  • The biggest single-benchmark swing is ARC-AGI-1: 35.7% for Claude Opus 4 and 53.5% for Gemini 3.5 Flash Lite.
  • Gemini 3.5 Flash Lite is cheaper at $0.30 / $2.50 per million input/output tokens, against $15 / $75 for Claude Opus 4.
  • Gemini 3.5 Flash Lite accepts more context: 1.05M tokens versus 200K.

Side by side

Claude Opus 4Gemini 3.5 Flash Lite
ProviderAnthropicGoogle
Noometry Index43.141.5
Released2025-05-222026-07-21
WeightsProprietaryProprietary
Context window200K1.05M
Max output32K66K
Input $ / M tokens$15$0.30
Output $ / M tokens$75$2.50
Results tracked5639

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 4 leads

Claude Opus 4: 47.2 (#62), Gemini 3.5 Flash Lite: 42.4 (#104)

BenchmarkClaude Opus 4Gemini 3.5 Flash Lite
WeirdML43.7%39%
LMArena Coding14421453
SWE-bench Verified70.7%—
SWE-bench Verified (bash only)67.6%—
Aider Polyglot72%—
LMArena WebDev—1440
SciCode—41.3%
GSO6.9%—
ALE-Bench—765.27
AlgoTune1.33—

Agentic & Tool Use Claude Opus 4 leads

Claude Opus 4: 34.8 (#42), Gemini 3.5 Flash Lite: 25.7 (#107)

BenchmarkClaude Opus 4Gemini 3.5 Flash Lite
APEX-Agents—29.3%
Cybench38%—
DeepResearch Bench46.8%—
GDP.pdf—10%
LMArena Search1127—
METR Time Horizons63.9%—

Reasoning Too close to call

Claude Opus 4: 27.3 (#121), Gemini 3.5 Flash Lite: 27.8 (#114)

BenchmarkClaude Opus 4Gemini 3.5 Flash Lite
ARC-AGI-28.6%10.3%
ARC-AGI-135.7%53.5%
CritPt0.3%0%
LMArena Hard Prompts13991441
DTBench81.6%83.5%
LMCA37.4%37.6%
Epoch Capabilities Index142.67145.13
SimpleBench58.8%—
Kagi LLM Benchmark74.3%—
NYT Connections (extended)—60.4%
Chess Puzzles—22%
EnigmaEval5.6%—
Mystery Game Puzzles—19%
ForecastBench61.1—

Math Claude Opus 4 leads

Claude Opus 4: 42.0 (#86), Gemini 3.5 Flash Lite: 25.9 (#264)

BenchmarkClaude Opus 4Gemini 3.5 Flash Lite
OTIS Mock AIME 2024-202564.4%71.1%
LMArena Math13901433
FrontierMath (Tiers 1-3)—26%
FrontierMath Tier 4—0%
ProofBench—13%
Omni-MATH61.6%—
MATH Level 585%—
FrontierMath (Feb 2025 set)4.5%—
FrontierMath Tier 4 (v1)4.2%—

Knowledge Gemini 3.5 Flash Lite leads

Claude Opus 4: 44.0 (#88), Gemini 3.5 Flash Lite: 50.1 (#72)

BenchmarkClaude Opus 4Gemini 3.5 Flash Lite
GPQA Diamond76.3%83.3%
LMArena Expert13861435
Humanity's Last Exam10.7%—
MMLU-Pro87.5%—
Confabulations15.9%—
Vectara Hallucination Rate12%—
GPQA (HELM)70.8%—

Multimodal Gemini 3.5 Flash Lite leads

Claude Opus 4: 31.5 (#106), Gemini 3.5 Flash Lite: 41.1 (#40)

BenchmarkClaude Opus 4Gemini 3.5 Flash Lite
LMArena Vision11921268
GeoBench49%—
VPCT38%—

Multilingual Gemini 3.5 Flash Lite leads

Claude Opus 4: 48.8 (#138), Gemini 3.5 Flash Lite: 53.5 (#63)

BenchmarkClaude Opus 4Gemini 3.5 Flash Lite
LMArena Non-English13621427
LMArena Chinese13861469
LMArena French13721451
LMArena German13911454
LMArena Japanese13311427
LMArena Korean13211407
LMArena Russian13921443
LMArena Spanish13891442

Instruction Following Claude Opus 4 leads

Claude Opus 4: 77.1 (#28), Gemini 3.5 Flash Lite: 74.8 (#85)

BenchmarkClaude Opus 4Gemini 3.5 Flash Lite
LMArena Instruction Following14061420
IFEval91.8%—

Long Context Gemini 3.5 Flash Lite leads

Claude Opus 4: 39.6 (#172), Gemini 3.5 Flash Lite: 43.9 (#84)

BenchmarkClaude Opus 4Gemini 3.5 Flash Lite
LMArena Longer Query14221435
Fiction.LiveBench61.1%—

Writing & Preference Gemini 3.5 Flash Lite leads

Claude Opus 4: 61.2 (#89), Gemini 3.5 Flash Lite: 64.2 (#57)

BenchmarkClaude Opus 4Gemini 3.5 Flash Lite
LMArena Text13771435
LMArena Creative Writing13871420
EQ-Bench Creative Writing15801559
LMArena Multi-Turn13961445
Short-Story Creative Writing83.6%—
WildBench85.2%—

Frequently asked questions

Is Claude Opus 4 better than Gemini 3.5 Flash Lite?

Claude Opus 4 is the stronger model overall, scoring 43.1 to 41.5 on the Noometry Index. Gemini 3.5 Flash Lite costs 35× less per token, which makes it the better buy when Claude Opus 4's lead doesn't matter for your workload.

Which is cheaper, Claude Opus 4 or Gemini 3.5 Flash Lite?

Gemini 3.5 Flash Lite is cheaper. It lists at $0.30 per million input tokens and $2.50 per million output tokens; Claude Opus 4 lists at $15 and $75.

Is Claude Opus 4 or Gemini 3.5 Flash Lite better for coding?

Claude Opus 4 scores higher on coding benchmarks: 47.2 versus 42.4 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.5 Flash Lite does, with 1.05M tokens against 200K.

How many benchmarks do Claude Opus 4 and Gemini 3.5 Flash Lite share?

28 benchmarks have published results for both models. Claude Opus 4 has 56 scored results on Noometry and Gemini 3.5 Flash Lite has 39.

Related comparisons

Go deeper