Noometry

Model comparison

Claude Haiku 4.5 vs Palm 2

Claude Haiku 4.5 is the stronger model overall, scoring 39.5 to 30.0 on the Noometry Index.

Last verified . 10 shared benchmarks.

Claude Haiku 4.5 Anthropic

39.5

Rank #165 Confirmed

Palm 2 Google

30.0

Rank #298 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Claude Haiku 4.5 scores higher in 6 categories and Palm 2 in 1 category; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Claude Haiku 4.5 leads 57.9 to 25.6.

Side by side

Claude Haiku 4.5Palm 2
ProviderAnthropicGoogle
Noometry Index39.530.0
Released2025-10-15—
WeightsProprietaryProprietary
Context window200K—
Max output64K—
Input $ / M tokens$1—
Output $ / M tokens$5—
Results tracked5310

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Haiku 4.5 leads

Claude Haiku 4.5: 44.0 (#78), Palm 2: 29.0 (#311)

BenchmarkClaude Haiku 4.5Palm 2
LMArena Coding1453994
SWE-bench Verified (bash only)66.6%—
LMArena WebDev1330—
SWE-bench Multilingual64.7%—
SciCode43.3%—
WeirdML45.4%—
ALE-Bench653.48—

Agentic & Tool Use Not comparable

Claude Haiku 4.5: 33.6 (#52), Palm 2: —

BenchmarkClaude Haiku 4.5Palm 2
Terminal-Bench35.5%—
Berkeley Function Calling Leaderboard68.7%—
DeepResearch Bench45.5%—
BALROG31.2%—
ExploitBench13.7%—
Vending-Bench 2458.89—

Reasoning Palm 2 leads

Claude Haiku 4.5: 15.1 (#320), Palm 2: 19.1 (#271)

BenchmarkClaude Haiku 4.5Palm 2
LMArena Hard Prompts14201005
ARC-AGI-24%—
NYT Connections (extended)14.3%—
ARC-AGI-147.7%—
CritPt0%—
Chess Puzzles8%—
DTBench73.6%—
LMCA30.9%—
Epoch Capabilities Index142.41—
ForecastBench61.4—

Math Claude Haiku 4.5 leads

Claude Haiku 4.5: 44.9 (#78), Palm 2: 30.8 (#231)

BenchmarkClaude Haiku 4.5Palm 2
LMArena Math13961049
OTIS Mock AIME 2024-202566.7%—
Omni-MATH56.1%—
MATH Level 596.4%—
FrontierMath (Feb 2025 set)5.9%—
FrontierMath Tier 4 (v1)2.1%—

Knowledge Not comparable

Claude Haiku 4.5: 37.7 (#153), Palm 2: —

BenchmarkClaude Haiku 4.5Palm 2
GPQA Diamond71.2%—
SimpleQA Verified13.2%—
MMLU-Pro77.7%—
Vectara Hallucination Rate9.8%—
GPQA (HELM)60.5%—
LMArena Expert1442—

Multimodal Not comparable

Claude Haiku 4.5: 26.8 (#118), Palm 2: —

BenchmarkClaude Haiku 4.5Palm 2
Blueprint-Bench 20%—
LMArena Document1420—

Multilingual Claude Haiku 4.5 leads

Claude Haiku 4.5: 49.9 (#129), Palm 2: 20.9 (#295)

BenchmarkClaude Haiku 4.5Palm 2
LMArena Non-English1377916
LMArena Chinese1417887
LMArena French1408—
LMArena German1375—
LMArena Japanese1339—
LMArena Korean1347—
LMArena Russian1381—
LMArena Spanish1420—

Instruction Following Claude Haiku 4.5 leads

Claude Haiku 4.5: 71.4 (#149), Palm 2: 51.0 (#296)

BenchmarkClaude Haiku 4.5Palm 2
LMArena Instruction Following14141010
IFEval80.1%—

Long Context Claude Haiku 4.5 leads

Claude Haiku 4.5: 43.6 (#92), Palm 2: 30.8 (#285)

BenchmarkClaude Haiku 4.5Palm 2
LMArena Longer Query14271010

Writing & Preference Claude Haiku 4.5 leads

Claude Haiku 4.5: 57.9 (#123), Palm 2: 25.6 (#304)

BenchmarkClaude Haiku 4.5Palm 2
LMArena Text13961027
LMArena Creative Writing1372991
LMArena Multi-Turn1409994
WildBench83.9%—
EQ-Bench 41064—

Frequently asked questions

Is Claude Haiku 4.5 better than Palm 2?

Claude Haiku 4.5 is the stronger model overall, scoring 39.5 to 30.0 on the Noometry Index.

Is Claude Haiku 4.5 or Palm 2 better for coding?

Claude Haiku 4.5 scores higher on coding benchmarks: 44.0 versus 29.0 in the Noometry coding category.

How many benchmarks do Claude Haiku 4.5 and Palm 2 share?

10 benchmarks have published results for both models. Claude Haiku 4.5 has 53 scored results on Noometry and Palm 2 has 10.

Related comparisons

Go deeper