Noometry

Model comparison

Claude Haiku 4.5 vs Gemini 3.5 Flash

Gemini 3.5 Flash is the stronger model overall, scoring 54.2 to 39.5 on the Noometry Index. Claude Haiku 4.5 costs 1.7× less per token, which makes it the better buy when Gemini 3.5 Flash's lead doesn't matter for your workload.

Last verified . 39 shared benchmarks.

Claude Haiku 4.5 Anthropic

39.5

Rank #165 Confirmed

Gemini 3.5 Flash Google

54.2

Rank #32 Confirmed

Summary

  • They share 39 benchmarks with published results for both. Claude Haiku 4.5 scores higher in 1 category and Gemini 3.5 Flash in 9 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3.5 Flash leads 62.8 to 15.1.
  • The biggest single-benchmark swing is NYT Connections (extended): 14.3% for Claude Haiku 4.5 and 92.6% for Gemini 3.5 Flash.
  • Claude Haiku 4.5 is cheaper at $1 / $5 per million input/output tokens, against $1.50 / $9 for Gemini 3.5 Flash.
  • Gemini 3.5 Flash accepts more context: 1.05M tokens versus 200K.

Side by side

Claude Haiku 4.5Gemini 3.5 Flash
ProviderAnthropicGoogle
Noometry Index39.554.2
Released2025-10-152026-05-19
WeightsProprietaryProprietary
Context window200K1.05M
Max output64K66K
Input $ / M tokens$1$1.50
Output $ / M tokens$5$9
Results tracked5354

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.5 Flash leads

Claude Haiku 4.5: 44.0 (#78), Gemini 3.5 Flash: 49.4 (#49)

BenchmarkClaude Haiku 4.5Gemini 3.5 Flash
LMArena WebDev13301499
SciCode43.3%53.1%
WeirdML45.4%62.6%
LMArena Coding14531492
ALE-Bench653.48911.02
SWE-bench Verified—79.3%
DeepSWE—37.4%
SWE-bench Verified (bash only)66.6%—
SWE-bench Multilingual64.7%—

Agentic & Tool Use Claude Haiku 4.5 leads

Claude Haiku 4.5: 33.6 (#52), Gemini 3.5 Flash: 24.7 (#114)

BenchmarkClaude Haiku 4.5Gemini 3.5 Flash
Vending-Bench 2458.895,396
Terminal-Bench35.5%—
APEX-Agents—27.5%
Berkeley Function Calling Leaderboard68.7%—
DeepResearch Bench45.5%—
BALROG31.2%—
ExploitBench13.7%—
GBAEval—6.7%
GDP.pdf—14%

Reasoning Gemini 3.5 Flash leads

Claude Haiku 4.5: 15.1 (#320), Gemini 3.5 Flash: 62.8 (#18)

BenchmarkClaude Haiku 4.5Gemini 3.5 Flash
ARC-AGI-24%72.1%
NYT Connections (extended)14.3%92.6%
ARC-AGI-147.7%92.5%
CritPt0%13.1%
Chess Puzzles8%50%
LMArena Hard Prompts14201488
DTBench73.6%94.7%
LMCA30.9%47.1%
Epoch Capabilities Index142.41154.46
ForecastBench61.459
SimpleBench—76.7%
EnigmaEval—25.4%
EBR-Bench—4.8%
Mystery Game Puzzles—32%
Surface Evolver Bench—58.1%

Math Gemini 3.5 Flash leads

Claude Haiku 4.5: 44.9 (#78), Gemini 3.5 Flash: 60.7 (#36)

BenchmarkClaude Haiku 4.5Gemini 3.5 Flash
OTIS Mock AIME 2024-202566.7%95.6%
LMArena Math13961504
FrontierMath (Feb 2025 set)5.9%39%
FrontierMath Tier 4 (v1)2.1%14.6%
FrontierMath (Tiers 1-3)—62.8%
FrontierMath Tier 4—26.8%
MathArena Final-Answer Competitions—76.3%
ProofBench—31%
Omni-MATH56.1%—
MATH Level 596.4%—

Knowledge Gemini 3.5 Flash leads

Claude Haiku 4.5: 37.7 (#153), Gemini 3.5 Flash: 66.3 (#11)

BenchmarkClaude Haiku 4.5Gemini 3.5 Flash
GPQA Diamond71.2%92.8%
SimpleQA Verified13.2%66.2%
LMArena Expert14421495
MMLU-Pro77.7%—
Vectara Hallucination Rate9.8%—
GPQA (HELM)60.5%—

Multimodal Gemini 3.5 Flash leads

Claude Haiku 4.5: 26.8 (#118), Gemini 3.5 Flash: 45.7 (#15)

BenchmarkClaude Haiku 4.5Gemini 3.5 Flash
Blueprint-Bench 20%33.6%
LMArena Document14201463
LMArena Vision—1310

Multilingual Gemini 3.5 Flash leads

Claude Haiku 4.5: 49.9 (#129), Gemini 3.5 Flash: 57.0 (#13)

BenchmarkClaude Haiku 4.5Gemini 3.5 Flash
LMArena Non-English13771476
LMArena Chinese14171526
LMArena French14081490
LMArena German13751492
LMArena Japanese13391486
LMArena Korean13471451
LMArena Russian13811493
LMArena Spanish14201480

Instruction Following Gemini 3.5 Flash leads

Claude Haiku 4.5: 71.4 (#149), Gemini 3.5 Flash: 77.0 (#30)

BenchmarkClaude Haiku 4.5Gemini 3.5 Flash
LMArena Instruction Following14141467
IFEval80.1%—

Long Context Gemini 3.5 Flash leads

Claude Haiku 4.5: 43.6 (#92), Gemini 3.5 Flash: 45.4 (#38)

BenchmarkClaude Haiku 4.5Gemini 3.5 Flash
LMArena Longer Query14271482

Writing & Preference Gemini 3.5 Flash leads

Claude Haiku 4.5: 57.9 (#123), Gemini 3.5 Flash: 65.5 (#47)

BenchmarkClaude Haiku 4.5Gemini 3.5 Flash
LMArena Text13961482
LMArena Creative Writing13721470
EQ-Bench 410641087
LMArena Multi-Turn14091481
WildBench83.9%—

Frequently asked questions

Is Claude Haiku 4.5 better than Gemini 3.5 Flash?

Gemini 3.5 Flash is the stronger model overall, scoring 54.2 to 39.5 on the Noometry Index. Claude Haiku 4.5 costs 1.7× less per token, which makes it the better buy when Gemini 3.5 Flash's lead doesn't matter for your workload.

Which is cheaper, Claude Haiku 4.5 or Gemini 3.5 Flash?

Claude Haiku 4.5 is cheaper. It lists at $1 per million input tokens and $5 per million output tokens; Gemini 3.5 Flash lists at $1.50 and $9.

Is Claude Haiku 4.5 or Gemini 3.5 Flash better for coding?

Gemini 3.5 Flash scores higher on coding benchmarks: 49.4 versus 44.0 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.5 Flash does, with 1.05M tokens against 200K.

How many benchmarks do Claude Haiku 4.5 and Gemini 3.5 Flash share?

39 benchmarks have published results for both models. Claude Haiku 4.5 has 53 scored results on Noometry and Gemini 3.5 Flash has 54.

Related comparisons

Go deeper