Model comparison

Claude Haiku 5.5 vs GPT-5 Nano

Claude Haiku 5.5 is the stronger model overall, scoring 49.5 to 33.5 on the Noometry Index.

Last verified . 6 shared benchmarks.

Claude Haiku 5.5 Anthropic

49.5

Rank #52 Confirmed

GPT-5 Nano OpenAI

33.5

Rank #241 Confirmed

Summary

  • They share 6 benchmarks with published results for both. Claude Haiku 5.5 scores higher in 5 categories and GPT-5 Nano in 0 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Haiku 5.5 leads 73.6 to 29.4.
  • The biggest single-benchmark swing is FrontierMath (Tiers 1-3): 75.1% for Claude Haiku 5.5 and 20% for GPT-5 Nano.
  • GPT-5 Nano is cheaper at $0.05 / $0.40 per million input/output tokens, against $0.10 / $0.50 for Claude Haiku 5.5.
  • Claude Haiku 5.5 accepts more context: 1M tokens versus 400K.

Side by side

Claude Haiku 5.5 and GPT-5 Nano specifications
Claude Haiku 5.5GPT-5 Nano
ProviderAnthropicOpenAI
Noometry Index49.533.5
Released2026-10-072025-08-07
WeightsProprietaryProprietary
Context window1M400K
Max output128K128K
Input $ / M tokens$0.10$0.05
Output $ / M tokens$0.50$0.40
Results tracked949

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Haiku 5.5 leads

Claude Haiku 5.5: 49.2 (#50), GPT-5 Nano: 33.6 (#254)

Coding benchmarks
BenchmarkClaude Haiku 5.5GPT-5 Nano
SWE-bench Verified (bash only)—34.8%
LMArena WebDev1587—
WeirdML—38.1%
LMArena Coding—1351
ALE-Bench—718.67

Agentic & Tool Use Not comparable

Claude Haiku 5.5: —, GPT-5 Nano: 25.8 (#106)

Agentic & Tool Use benchmarks
BenchmarkClaude Haiku 5.5GPT-5 Nano
Terminal-Bench—21.8%
Berkeley Function Calling Leaderboard—51.5%

Reasoning Claude Haiku 5.5 leads

Claude Haiku 5.5: 35.2 (#69), GPT-5 Nano: 16.3 (#306)

Reasoning benchmarks
BenchmarkClaude Haiku 5.5GPT-5 Nano
Mystery Game Puzzles30%9%
ARC-AGI-2—2.6%
Kagi LLM Benchmark—62.2%
NYT Connections (extended)65.7%—
ARC-AGI-1—20.7%
Chess Puzzles—27%
LMArena Hard Prompts—1328
DTBench—62.7%
LMCA—7.9%
Epoch Capabilities Index—139.38
ForecastBench—59.1

Math Claude Haiku 5.5 leads

Claude Haiku 5.5: 73.6 (#18), GPT-5 Nano: 29.4 (#241)

Math benchmarks
BenchmarkClaude Haiku 5.5GPT-5 Nano
FrontierMath (Tiers 1-3)75.1%20%
FrontierMath Tier 446.3%2.4%
OTIS Mock AIME 2024-202598.9%81.1%
ProofBench—12%
Omni-MATH—54.6%
LMArena Math—1317
MATH Level 5—95.2%
FrontierMath (Feb 2025 set)—8.3%
FrontierMath Tier 4 (v1)—2.1%

Knowledge Claude Haiku 5.5 leads

Claude Haiku 5.5: 50.8 (#70), GPT-5 Nano: 35.9 (#178)

Knowledge benchmarks
BenchmarkClaude Haiku 5.5GPT-5 Nano
GPQA Diamond89.6%69.4%
SimpleQA Verified23.8%11.7%
MMLU-Pro—77.8%
Vectara Hallucination Rate—10.5%
GPQA (HELM)—67.9%
LMArena Expert—1321

Multimodal Claude Haiku 5.5 leads

Claude Haiku 5.5: 43.7 (#21), GPT-5 Nano: 31.3 (#108)

Multimodal benchmarks
BenchmarkClaude Haiku 5.5GPT-5 Nano
LMArena Vision—1159
VPCT—37.2%
Furniture Assembly47.5%—

Multilingual Not comparable

Claude Haiku 5.5: —, GPT-5 Nano: 45.3 (#172)

Multilingual benchmarks
BenchmarkClaude Haiku 5.5GPT-5 Nano
LMArena Non-English—1313
LMArena Chinese—1356
LMArena German—1327
LMArena Japanese—1226
LMArena Korean—1269
LMArena Russian—1296
LMArena Spanish—1360

Instruction Following Not comparable

Claude Haiku 5.5: —, GPT-5 Nano: 75.0 (#79)

Instruction Following benchmarks
BenchmarkClaude Haiku 5.5GPT-5 Nano
IFEval—93.2%
LMArena Instruction Following—1306

Long Context Not comparable

Claude Haiku 5.5: —, GPT-5 Nano: 31.3 (#281)

Long Context benchmarks
BenchmarkClaude Haiku 5.5GPT-5 Nano
Fiction.LiveBench—44.4%
LMArena Longer Query—1312

Writing & Preference Not comparable

Claude Haiku 5.5: —, GPT-5 Nano: 39.1 (#249)

Writing & Preference benchmarks
BenchmarkClaude Haiku 5.5GPT-5 Nano
LMArena Text—1320
LMArena Creative Writing—1249
EQ-Bench Creative Writing—705
WildBench—80.6%
LMArena Multi-Turn—1311

Frequently asked questions

Is Claude Haiku 5.5 better than GPT-5 Nano?

Claude Haiku 5.5 is the stronger model overall, scoring 49.5 to 33.5 on the Noometry Index.

Which is cheaper, Claude Haiku 5.5 or GPT-5 Nano?

GPT-5 Nano is cheaper. It lists at $0.05 per million input tokens and $0.40 per million output tokens; Claude Haiku 5.5 lists at $0.10 and $0.50.

Is Claude Haiku 5.5 or GPT-5 Nano better for coding?

Claude Haiku 5.5 scores higher on coding benchmarks: 49.2 versus 33.6 in the Noometry coding category.

Which has the bigger context window?

Claude Haiku 5.5 does, with 1M tokens against 400K.

How many benchmarks do Claude Haiku 5.5 and GPT-5 Nano share?

6 benchmarks have published results for both models. Claude Haiku 5.5 has 9 scored results on Noometry and GPT-5 Nano has 49.

Related comparisons

Go deeper