Model comparison

Claude Haiku 5.5 vs Codellama 34b Instruct

Claude Haiku 5.5 is the stronger model overall, scoring 49.5 to 30.8 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude Haiku 5.5 Anthropic

49.5

Rank #52 Confirmed

Codellama 34b Instruct Meta

30.8

Rank #287 Confirmed

Summary

  • The widest gap is in math, where Claude Haiku 5.5 leads 73.6 to 31.0.
  • Codellama 34b Instruct has downloadable open weights; the other is API-only.

Side by side

Claude Haiku 5.5 and Codellama 34b Instruct specifications
Claude Haiku 5.5Codellama 34b Instruct
ProviderAnthropicMeta
Noometry Index49.530.8
Released2026-10-07—
WeightsProprietaryOpen
Context window1M—
Max output128K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.50—
Results tracked914

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Haiku 5.5 leads

Claude Haiku 5.5: 49.2 (#50), Codellama 34b Instruct: 28.5 (#314)

Coding benchmarks
BenchmarkClaude Haiku 5.5Codellama 34b Instruct
LMArena WebDev1587—
BigCodeBench Instruct—29%
LMArena Coding—1046
BigCodeBench Complete—37.1%
HumanEval+—43.9%
MBPP+—56.3%

Reasoning Claude Haiku 5.5 leads

Claude Haiku 5.5: 35.2 (#69), Codellama 34b Instruct: 19.6 (#255)

Reasoning benchmarks
BenchmarkClaude Haiku 5.5Codellama 34b Instruct
NYT Connections (extended)65.7%—
LMArena Hard Prompts—1032
Mystery Game Puzzles30%—

Math Claude Haiku 5.5 leads

Claude Haiku 5.5: 73.6 (#18), Codellama 34b Instruct: 31.0 (#230)

Math benchmarks
BenchmarkClaude Haiku 5.5Codellama 34b Instruct
FrontierMath (Tiers 1-3)75.1%—
FrontierMath Tier 446.3%—
OTIS Mock AIME 2024-202598.9%—
LMArena Math—1056

Knowledge Not comparable

Claude Haiku 5.5: 50.8 (#70), Codellama 34b Instruct: —

Knowledge benchmarks
BenchmarkClaude Haiku 5.5Codellama 34b Instruct
GPQA Diamond89.6%—
SimpleQA Verified23.8%—

Multimodal Not comparable

Claude Haiku 5.5: 43.7 (#21), Codellama 34b Instruct: —

Multimodal benchmarks
BenchmarkClaude Haiku 5.5Codellama 34b Instruct
Furniture Assembly47.5%—

Multilingual Not comparable

Claude Haiku 5.5: —, Codellama 34b Instruct: 25.8 (#284)

Multilingual benchmarks
BenchmarkClaude Haiku 5.5Codellama 34b Instruct
LMArena Non-English—1011
LMArena Chinese—976

Instruction Following Not comparable

Claude Haiku 5.5: —, Codellama 34b Instruct: 52.2 (#291)

Instruction Following benchmarks
BenchmarkClaude Haiku 5.5Codellama 34b Instruct
LMArena Instruction Following—1028

Long Context Not comparable

Claude Haiku 5.5: —, Codellama 34b Instruct: 30.9 (#284)

Long Context benchmarks
BenchmarkClaude Haiku 5.5Codellama 34b Instruct
LMArena Longer Query—1013

Writing & Preference Not comparable

Claude Haiku 5.5: —, Codellama 34b Instruct: 28.2 (#297)

Writing & Preference benchmarks
BenchmarkClaude Haiku 5.5Codellama 34b Instruct
LMArena Text—1066
LMArena Creative Writing—1032
LMArena Multi-Turn—1015

Frequently asked questions

Is Claude Haiku 5.5 better than Codellama 34b Instruct?

Claude Haiku 5.5 is the stronger model overall, scoring 49.5 to 30.8 on the Noometry Index.

Is Claude Haiku 5.5 or Codellama 34b Instruct better for coding?

Claude Haiku 5.5 scores higher on coding benchmarks: 49.2 versus 28.5 in the Noometry coding category.

How many benchmarks do Claude Haiku 5.5 and Codellama 34b Instruct share?

0 benchmarks have published results for both models. Claude Haiku 5.5 has 9 scored results on Noometry and Codellama 34b Instruct has 14.

Related comparisons

Go deeper