Noometry

Model comparison

Gemma 4 26B A4B IT vs Llama 2-13B

Gemma 4 26B A4B IT is the stronger model overall, scoring 43.1 to 29.1 on the Noometry Index.

Last verified . 17 shared benchmarks.

Gemma 4 26B A4B IT Google

43.1

Rank #88 Confirmed

Llama 2-13B Meta

29.1

Rank #304 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Gemma 4 26B A4B IT scores higher in 8 categories and Llama 2-13B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Gemma 4 26B A4B IT leads 58.8 to 30.0.
  • The biggest single-benchmark swing is DTBench: 74.9% for Gemma 4 26B A4B IT and 42.2% for Llama 2-13B.

Side by side

Gemma 4 26B A4B ITLlama 2-13B
ProviderGoogleMeta
Noometry Index43.129.1
Released2026-04-022023-07-18
WeightsOpenOpen
Context window262K—
Max output33K—
Input $ / M tokens$0.0765—
Output $ / M tokens$0.26—
Results tracked2832

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 38.8 (#156), Llama 2-13B: 30.4 (#287)

BenchmarkGemma 4 26B A4B ITLlama 2-13B
LMArena Coding14461062
LMArena WebDev1359—
SciCode40%—
WeirdML35.2%—
ALE-Bench927.17—

Reasoning Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 21.1 (#205), Llama 2-13B: 12.3 (#333)

BenchmarkGemma 4 26B A4B ITLlama 2-13B
Chess Puzzles6%0%
LMArena Hard Prompts14381051
DTBench74.9%42.2%
Epoch Capabilities Index141.85105.8
CritPt0%—
LMCA29.7%—
BIG-Bench Hard—58.2%
HellaSwag—80.7%
LAMBADA—76.5%
PIQA—80.8%
WinoGrande—72.8%

Math Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 45.7 (#61), Llama 2-13B: 28.7 (#226)

BenchmarkGemma 4 26B A4B ITLlama 2-13B
LMArena Math14691065
OTIS Mock AIME 2024-202582.2%—
GSM8K—36.9%

Knowledge Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 45.6 (#79), Llama 2-13B: 27.5 (#244)

BenchmarkGemma 4 26B A4B ITLlama 2-13B
LMArena Expert14471030
GPQA Diamond73.2%—
Vectara Hallucination Rate5.2%—
ARC (AI2) Challenge—60.3%
BoolQ—82.4%
MMLU—55.6%
OpenBookQA—57%
TriviaQA—79.6%

Multimodal Not comparable

Gemma 4 26B A4B IT: 39.9 (#43), Llama 2-13B: —

BenchmarkGemma 4 26B A4B ITLlama 2-13B
LMArena Vision1260—
ScienceQA—55.8%

Multilingual Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 53.3 (#68), Llama 2-13B: 26.7 (#274)

BenchmarkGemma 4 26B A4B ITLlama 2-13B
LMArena Non-English14221024
LMArena Chinese14951001
LMArena French14591043
LMArena Russian14341055
LMArena Spanish14151086
LMArena German—1009
LMArena Japanese—894
LMArena Korean—953

Instruction Following Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 75.0 (#78), Llama 2-13B: 53.5 (#282)

BenchmarkGemma 4 26B A4B ITLlama 2-13B
LMArena Instruction Following14201046

Long Context Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 43.6 (#87), Llama 2-13B: 32.3 (#264)

BenchmarkGemma 4 26B A4B ITLlama 2-13B
LMArena Longer Query14271064

Writing & Preference Gemma 4 26B A4B IT leads

Gemma 4 26B A4B IT: 58.8 (#110), Llama 2-13B: 30.0 (#284)

BenchmarkGemma 4 26B A4B ITLlama 2-13B
LMArena Text14341085
LMArena Creative Writing14011047
LMArena Multi-Turn14421050
EQ-Bench Creative Writing1305—

Frequently asked questions

Is Gemma 4 26B A4B IT better than Llama 2-13B?

Gemma 4 26B A4B IT is the stronger model overall, scoring 43.1 to 29.1 on the Noometry Index.

Is Gemma 4 26B A4B IT or Llama 2-13B better for coding?

Gemma 4 26B A4B IT scores higher on coding benchmarks: 38.8 versus 30.4 in the Noometry coding category.

How many benchmarks do Gemma 4 26B A4B IT and Llama 2-13B share?

17 benchmarks have published results for both models. Gemma 4 26B A4B IT has 28 scored results on Noometry and Llama 2-13B has 32.

Related comparisons

Go deeper