Model comparison

Claude Haiku 4.5 vs DeepSeek-V3

Claude Haiku 4.5 and DeepSeek-V3 score almost the same on the Noometry Index (39.3 vs 39.2), so choose on price, context window or the category you care about most.

Last verified . 34 shared benchmarks.

Claude Haiku 4.5 Anthropic

39.3

Rank #155 Confirmed

DeepSeek-V3 DeepSeek

39.2

Rank #157 Confirmed

Summary

  • They share 34 benchmarks with published results for both. Claude Haiku 4.5 scores higher in 6 categories and DeepSeek-V3 in 2 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Haiku 4.5 leads 43.0 to 30.4.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 66.7% for Claude Haiku 4.5 and 37.8% for DeepSeek-V3.
  • DeepSeek-V3 is cheaper at $0.24 / $0.90 per million input/output tokens, against $1 / $5 for Claude Haiku 4.5.
  • Claude Haiku 4.5 accepts more context: 200K tokens versus 164K.
  • DeepSeek-V3 has downloadable open weights; the other is API-only.

Side by side

Claude Haiku 4.5 and DeepSeek-V3 specifications
Claude Haiku 4.5DeepSeek-V3
ProviderAnthropicDeepSeek
Noometry Index39.339.2
Released2025-10-152024-12-26
WeightsProprietaryOpen
Context window200K164K
Max output64K164K
Input $ / M tokens$1$0.24
Output $ / M tokens$5$0.90
Results tracked5360

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Haiku 4.5 leads

Claude Haiku 4.5: 43.9 (#71), DeepSeek-V3: 41.9 (#99)

Coding benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
SciCode43.3%35.8%
WeirdML45.4%36.1%
LMArena Coding14541368
SWE-bench Verified (bash only)66.6%—
Aider Polyglot—55.1%
LMArena WebDev1330—
SWE-bench Multilingual64.7%—
BigCodeBench Instruct—50%
LiveBench Coding—70.9%
BigCodeBench Complete—62.2%
ALE-Bench653.48—
HumanEval+—86.6%
MBPP+—73%

Agentic & Tool Use Not comparable

Claude Haiku 4.5: 33.5 (#50), DeepSeek-V3: —

Agentic & Tool Use benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
Terminal-Bench35.5%—
Berkeley Function Calling Leaderboard68.7%—
DeepResearch Bench45.5%—
BALROG31.2%—
ExploitBench13.7%—
METR Time Horizons—49.6%
Vending-Bench 2458.89—

Reasoning DeepSeek-V3 leads

Claude Haiku 4.5: 15.1 (#310), DeepSeek-V3: 20.0 (#226)

Reasoning benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
CritPt0%0%
LMArena Hard Prompts14201365
DTBench73.6%64.8%
LMCA30.9%15.5%
Epoch Capabilities Index142.42135.95
ForecastBench61.459.1
ARC-AGI-24%—
SimpleBench—27.2%
Kagi LLM Benchmark—52.3%
NYT Connections (extended)14.3%—
ARC-AGI-147.7%—
Chess Puzzles8%—
LiveBench Reasoning—65.8%
LiveBench Data Analysis—60.9%
BIG-Bench Hard—87.5%
HellaSwag—88.9%
LiveBench—66.9%
PIQA—84.7%
WinoGrande—85.2%

Math Claude Haiku 4.5 leads

Claude Haiku 4.5: 43.0 (#69), DeepSeek-V3: 30.4 (#208)

Math benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
OTIS Mock AIME 2024-202566.7%37.8%
Omni-MATH56.1%40.3%
LMArena Math13951373
MATH Level 596.4%75.5%
FrontierMath (Feb 2025 set)5.9%1.7%
LiveBench Math—73.5%
FrontierMath Tier 4 (v1)2.1%—

Knowledge Too close to call

Claude Haiku 4.5: 37.6 (#146), DeepSeek-V3: 37.5 (#147)

Knowledge benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
GPQA Diamond71.2%67.6%
MMLU-Pro77.7%72.3%
Vectara Hallucination Rate9.8%6.1%
GPQA (HELM)60.5%53.8%
LMArena Expert14431352
SimpleQA Verified13.2%—
Confabulations—26.1%
ARC (AI2) Challenge—95.3%
MMLU—87.2%
TriviaQA—82.9%

Multimodal Not comparable

Claude Haiku 4.5: 27.0 (#111), DeepSeek-V3: —

Multimodal benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
Blueprint-Bench 20%—
LMArena Document1420—

Multilingual Claude Haiku 4.5 leads

Claude Haiku 4.5: 50.1 (#124), DeepSeek-V3: 48.8 (#138)

Multilingual benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
LMArena Non-English13761358
LMArena Chinese14151390
LMArena French14081386
LMArena German13771374
LMArena Japanese13391333
LMArena Korean13461321
LMArena Russian13801372
LMArena Spanish14201358

Instruction Following DeepSeek-V3 leads

Claude Haiku 4.5: 71.6 (#144), DeepSeek-V3: 73.0 (#125)

Instruction Following benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
IFEval80.1%83.2%
LMArena Instruction Following14141345
LiveBench Instruction Following—81.5%

Long Context Claude Haiku 4.5 leads

Claude Haiku 4.5: 43.6 (#86), DeepSeek-V3: 34.0 (#248)

Long Context benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
LMArena Longer Query14271353
Fiction.LiveBench—50%

Writing & Preference Too close to call

Claude Haiku 4.5: 58.1 (#119), DeepSeek-V3: 57.6 (#124)

Writing & Preference benchmarks
BenchmarkClaude Haiku 4.5DeepSeek-V3
LMArena Text13961375
LMArena Creative Writing13711364
WildBench83.9%83%
LMArena Multi-Turn14091389
Short-Story Creative Writing—77%
EQ-Bench Creative Writing—1472
EQ-Bench 41064—
LiveBench Language—49.1%

Frequently asked questions

Is Claude Haiku 4.5 better than DeepSeek-V3?

Claude Haiku 4.5 and DeepSeek-V3 score almost the same on the Noometry Index (39.3 vs 39.2), so choose on price, context window or the category you care about most.

Which is cheaper, Claude Haiku 4.5 or DeepSeek-V3?

DeepSeek-V3 is cheaper. It lists at $0.24 per million input tokens and $0.90 per million output tokens; Claude Haiku 4.5 lists at $1 and $5.

Is Claude Haiku 4.5 or DeepSeek-V3 better for coding?

Claude Haiku 4.5 scores higher on coding benchmarks: 43.9 versus 41.9 in the Noometry coding category.

Which has the bigger context window?

Claude Haiku 4.5 does, with 200K tokens against 164K.

How many benchmarks do Claude Haiku 4.5 and DeepSeek-V3 share?

34 benchmarks have published results for both models. Claude Haiku 4.5 has 53 scored results on Noometry and DeepSeek-V3 has 60.

Related comparisons

Go deeper