Model comparison

Claude 3 Haiku vs Claude Opus 4.6

Claude Opus 4.6 is the stronger model overall, scoring 58.3 to 25.7 on the Noometry Index.

Last verified . 27 shared benchmarks.

Claude 3 Haiku Anthropic

25.7

Rank #333 Confirmed

Claude Opus 4.6 Anthropic

58.3

Rank #18 Confirmed

Summary

  • They share 27 benchmarks with published results for both. Claude 3 Haiku scores higher in 0 categories and Claude Opus 4.6 in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Opus 4.6 leads 62.7 to 9.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.8% for Claude 3 Haiku and 94.4% for Claude Opus 4.6.

Side by side

Claude 3 Haiku and Claude Opus 4.6 specifications
Claude 3 HaikuClaude Opus 4.6
ProviderAnthropicAnthropic
Noometry Index25.758.3
Released2024-03-072026-02-04
WeightsProprietaryProprietary
Context window—1M
Max output—128K
Input $ / M tokens—$5
Output $ / M tokens—$25
Results tracked3768

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 4.6 leads

Claude 3 Haiku: 26.1 (#320), Claude Opus 4.6: 57.7 (#15)

Coding benchmarks
BenchmarkClaude 3 HaikuClaude Opus 4.6
WeirdML9.8%78%
LMArena Coding11991535
SWE-bench Verified—78.7%
FrontierCode—26.6%
SWE-bench Verified (bash only)—75.6%
LMArena WebDev—1546
SWE-bench Multilingual—72%
GSO—41.2%
BigCodeBench Instruct39.4%—
BigCodeBench Complete50.1%—
CadEval12%—
ALE-Bench—996.5
AlgoTune—1.47
HumanEval+68.9%—
MBPP+68.8%—

Agentic & Tool Use Not comparable

Claude 3 Haiku: —, Claude Opus 4.6: 51.0 (#4)

Agentic & Tool Use benchmarks
BenchmarkClaude 3 HaikuClaude Opus 4.6
Terminal-Bench—79.8%
APEX-Agents—46.3%
Remote Labor Index—4.2%
τ²-bench Banking—27.3%
Cybench—93%
DeepResearch Bench—55.3%
GBAEval—44.1%
LMArena Search—1253
METR Time Horizons—78.9%
Vending-Bench 2—8,018

Reasoning Claude Opus 4.6 leads

Claude 3 Haiku: 15.7 (#303), Claude Opus 4.6: 57.7 (#21)

Reasoning benchmarks
BenchmarkClaude 3 HaikuClaude Opus 4.6
Kagi LLM Benchmark34.2%83.6%
LMArena Hard Prompts11741527
DTBench50.1%91.2%
LMCA8.8%55.8%
Epoch Capabilities Index118.3155.36
ForecastBench53.260
ARC-AGI-2—69.2%
SimpleBench—67.6%
NYT Connections (extended)—92.1%
ARC-AGI-1—94%
Chess Puzzles—17%
EnigmaEval—7.6%
Thematic Generalization—80.6%
EBR-Bench—12.7%
Mystery Game Puzzles—25%
WinoGrande74.2%—

Math Claude Opus 4.6 leads

Claude 3 Haiku: 9.2 (#313), Claude Opus 4.6: 62.7 (#25)

Knowledge Claude Opus 4.6 leads

Claude 3 Haiku: 17.3 (#280), Claude Opus 4.6: 61.8 (#23)

Knowledge benchmarks
BenchmarkClaude 3 HaikuClaude Opus 4.6
GPQA Diamond36.3%90.5%
LMArena Expert11481546
Humanity's Last Exam—34.4%
SimpleQA Verified—47%
Confabulations34.2%—
Vectara Hallucination Rate—12.2%
MMLU73.8%—

Multimodal Claude Opus 4.6 leads

Claude 3 Haiku: 23.1 (#123), Claude Opus 4.6: 37.0 (#67)

Multimodal benchmarks
BenchmarkClaude 3 HaikuClaude Opus 4.6
LMArena Vision9501316
Furniture Assembly—28.3%
LMArena Document—1507
ScienceQA72%—

Multilingual Claude Opus 4.6 leads

Claude 3 Haiku: 36.1 (#238), Claude Opus 4.6: 58.2 (#4)

Multilingual benchmarks
BenchmarkClaude 3 HaikuClaude Opus 4.6
LMArena Non-English11781490
LMArena Chinese11551551
LMArena French11941513
LMArena German11741504
LMArena Japanese11021484
LMArena Korean11081465
LMArena Russian12041497
LMArena Spanish11651512

Instruction Following Claude Opus 4.6 leads

Claude 3 Haiku: 61.5 (#242), Claude Opus 4.6: 79.7 (#3)

Instruction Following benchmarks
BenchmarkClaude 3 HaikuClaude Opus 4.6
LMArena Instruction Following11741523

Long Context Claude Opus 4.6 leads

Claude 3 Haiku: 36.1 (#232), Claude Opus 4.6: 48.1 (#13)

Long Context benchmarks
BenchmarkClaude 3 HaikuClaude Opus 4.6
LMArena Longer Query11911520
CL-bench—20.7%
CL-bench Life—17%

Writing & Preference Claude Opus 4.6 leads

Claude 3 Haiku: 29.8 (#286), Claude Opus 4.6: 73.7 (#9)

Writing & Preference benchmarks
BenchmarkClaude 3 HaikuClaude Opus 4.6
LMArena Text11951504
LMArena Creative Writing11571506
EQ-Bench Creative Writing7171809
LMArena Multi-Turn11901514
EQ-Bench 4—1223

Frequently asked questions

Is Claude 3 Haiku better than Claude Opus 4.6?

Claude Opus 4.6 is the stronger model overall, scoring 58.3 to 25.7 on the Noometry Index.

Is Claude 3 Haiku or Claude Opus 4.6 better for coding?

Claude Opus 4.6 scores higher on coding benchmarks: 57.7 versus 26.1 in the Noometry coding category.

How many benchmarks do Claude 3 Haiku and Claude Opus 4.6 share?

27 benchmarks have published results for both models. Claude 3 Haiku has 37 scored results on Noometry and Claude Opus 4.6 has 68.

Related comparisons

Go deeper