Model comparison

Llama 3.2 1B vs Palm 2

Palm 2 is the stronger model overall, scoring 30.0 to 20.1 on the Noometry Index.

Last verified . 10 shared benchmarks.

Llama 3.2 1B Meta

20.1

Rank #354 Confirmed

Palm 2 Google

30.0

Rank #298 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Llama 3.2 1B scores higher in 3 categories and Palm 2 in 4 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where Palm 2 leads 30.8 to 10.4.
  • Llama 3.2 1B has downloadable open weights; the other is API-only.

Side by side

Llama 3.2 1B and Palm 2 specifications
Llama 3.2 1BPalm 2
ProviderMetaGoogle
Noometry Index20.130.0
Released2024-09-24—
WeightsOpenProprietary
Context window60K—
Max output54K—
Input $ / M tokens$0.027—
Output $ / M tokens$0.20—
Results tracked2210

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Palm 2 leads

Llama 3.2 1B: 21.1 (#338), Palm 2: 29.0 (#311)

Coding benchmarks
BenchmarkLlama 3.2 1BPalm 2
LMArena Coding1070994
BigCodeBench Instruct8.2%—
BigCodeBench Complete11.3%—

Agentic & Tool Use Not comparable

Llama 3.2 1B: 14.6 (#150), Palm 2: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 1BPalm 2
Berkeley Function Calling Leaderboard10.8%—
BALROG6.6%—

Reasoning Palm 2 leads

Llama 3.2 1B: 16.2 (#308), Palm 2: 19.1 (#271)

Reasoning benchmarks
BenchmarkLlama 3.2 1BPalm 2
LMArena Hard Prompts10441005
Chess Puzzles0%—
Epoch Capabilities Index101.99—

Math Palm 2 leads

Llama 3.2 1B: 10.4 (#313), Palm 2: 30.8 (#231)

Math benchmarks
BenchmarkLlama 3.2 1BPalm 2
LMArena Math10861049
OTIS Mock AIME 2024-20250.6%—

Knowledge Not comparable

Llama 3.2 1B: 7.2 (#312), Palm 2: —

Knowledge benchmarks
BenchmarkLlama 3.2 1BPalm 2
GPQA Diamond23.9%—
LMArena Expert1007—

Multilingual Llama 3.2 1B leads

Llama 3.2 1B: 23.8 (#292), Palm 2: 20.9 (#295)

Multilingual benchmarks
BenchmarkLlama 3.2 1BPalm 2
LMArena Non-English973916
LMArena Chinese959887
LMArena German1014—
LMArena Russian941—

Instruction Following Llama 3.2 1B leads

Llama 3.2 1B: 52.4 (#290), Palm 2: 51.0 (#296)

Instruction Following benchmarks
BenchmarkLlama 3.2 1BPalm 2
LMArena Instruction Following10311010

Long Context Llama 3.2 1B leads

Llama 3.2 1B: 31.9 (#274), Palm 2: 30.8 (#285)

Long Context benchmarks
BenchmarkLlama 3.2 1BPalm 2
LMArena Longer Query10501010

Writing & Preference Palm 2 leads

Llama 3.2 1B: 21.3 (#310), Palm 2: 25.6 (#304)

Writing & Preference benchmarks
BenchmarkLlama 3.2 1BPalm 2
LMArena Text10551027
LMArena Creative Writing1033991
LMArena Multi-Turn1030994
EQ-Bench Creative Writing200—

Frequently asked questions

Is Llama 3.2 1B better than Palm 2?

Palm 2 is the stronger model overall, scoring 30.0 to 20.1 on the Noometry Index.

Is Llama 3.2 1B or Palm 2 better for coding?

Palm 2 scores higher on coding benchmarks: 29.0 versus 21.1 in the Noometry coding category.

How many benchmarks do Llama 3.2 1B and Palm 2 share?

10 benchmarks have published results for both models. Llama 3.2 1B has 22 scored results on Noometry and Palm 2 has 10.

Related comparisons

Go deeper