Noometry

Model comparison

Codellama 34b Instruct vs Gemma 4 26B A4B IT

Gemma 4 26B A4B IT is the stronger model overall, scoring 43.5 to 30.8 on the Noometry Index.

Last verified . 10 shared benchmarks.

Codellama 34b Instruct Meta

30.8

Rank #287 Confirmed

Gemma 4 26B A4B IT Google

43.5

Rank #92 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Codellama 34b Instruct scores higher in 0 categories and Gemma 4 26B A4B IT in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemma 4 26B A4B IT leads 58.6 to 28.2.

Side by side

Codellama 34b InstructGemma 4 26B A4B IT
ProviderMetaGoogle
Noometry Index30.843.5
Released—2026-04-02
WeightsOpenOpen
Context window—262K
Max output—33K
Input $ / M tokens—$0.0675
Output $ / M tokens—$0.23
Results tracked1428

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemma 4 26B A4B IT leads

Codellama 34b Instruct: 28.5 (#314), Gemma 4 26B A4B IT: 39.0 (#164)

BenchmarkCodellama 34b InstructGemma 4 26B A4B IT
LMArena Coding10461447
LMArena WebDev—1359
SciCode—40%
WeirdML—35.2%
BigCodeBench Instruct29%—
BigCodeBench Complete37.1%—
ALE-Bench—927.17
HumanEval+43.9%—
MBPP+56.3%—

Reasoning Gemma 4 26B A4B IT leads

Codellama 34b Instruct: 19.6 (#255), Gemma 4 26B A4B IT: 21.8 (#213)

BenchmarkCodellama 34b InstructGemma 4 26B A4B IT
LMArena Hard Prompts10321439
CritPt—0%
Chess Puzzles—6%
DTBench—74.9%
LMCA—29.7%
Epoch Capabilities Index—141.85

Math Gemma 4 26B A4B IT leads

Codellama 34b Instruct: 31.0 (#230), Gemma 4 26B A4B IT: 47.6 (#67)

BenchmarkCodellama 34b InstructGemma 4 26B A4B IT
LMArena Math10561470
OTIS Mock AIME 2024-2025—82.2%

Knowledge Not comparable

Codellama 34b Instruct: —, Gemma 4 26B A4B IT: 45.7 (#85)

BenchmarkCodellama 34b InstructGemma 4 26B A4B IT
GPQA Diamond—73.2%
Vectara Hallucination Rate—5.2%
LMArena Expert—1447

Multimodal Not comparable

Codellama 34b Instruct: —, Gemma 4 26B A4B IT: 40.6 (#46)

BenchmarkCodellama 34b InstructGemma 4 26B A4B IT
LMArena Vision—1260

Multilingual Gemma 4 26B A4B IT leads

Codellama 34b Instruct: 25.8 (#284), Gemma 4 26B A4B IT: 53.1 (#71)

BenchmarkCodellama 34b InstructGemma 4 26B A4B IT
LMArena Non-English10111421
LMArena Chinese9761495
LMArena French—1460
LMArena Russian—1434
LMArena Spanish—1417

Instruction Following Gemma 4 26B A4B IT leads

Codellama 34b Instruct: 52.2 (#291), Gemma 4 26B A4B IT: 74.8 (#82)

BenchmarkCodellama 34b InstructGemma 4 26B A4B IT
LMArena Instruction Following10281420

Long Context Gemma 4 26B A4B IT leads

Codellama 34b Instruct: 30.9 (#284), Gemma 4 26B A4B IT: 43.6 (#91)

BenchmarkCodellama 34b InstructGemma 4 26B A4B IT
LMArena Longer Query10131428

Writing & Preference Gemma 4 26B A4B IT leads

Codellama 34b Instruct: 28.2 (#297), Gemma 4 26B A4B IT: 58.6 (#115)

BenchmarkCodellama 34b InstructGemma 4 26B A4B IT
LMArena Text10661434
LMArena Creative Writing10321402
LMArena Multi-Turn10151441
EQ-Bench Creative Writing—1305

Frequently asked questions

Is Codellama 34b Instruct better than Gemma 4 26B A4B IT?

Gemma 4 26B A4B IT is the stronger model overall, scoring 43.5 to 30.8 on the Noometry Index.

Is Codellama 34b Instruct or Gemma 4 26B A4B IT better for coding?

Gemma 4 26B A4B IT scores higher on coding benchmarks: 39.0 versus 28.5 in the Noometry coding category.

How many benchmarks do Codellama 34b Instruct and Gemma 4 26B A4B IT share?

10 benchmarks have published results for both models. Codellama 34b Instruct has 14 scored results on Noometry and Gemma 4 26B A4B IT has 28.

Related comparisons

Go deeper