Model comparison

Llama 3.2 1B vs Mercury 2.5

Mercury 2.5 is the stronger model overall, scoring 33.5 to 20.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Llama 3.2 1B Meta

20.1

Rank #354 Confirmed

Mercury 2.5 Inception

33.5

Rank #242 Reported

Summary

  • The widest gap is in coding, where Mercury 2.5 leads 39.5 to 21.1.
  • Both cost about the same: $0.027 input and $0.20 output per million tokens.
  • Mercury 2.5 accepts more context: 260K tokens versus 60K.
  • Llama 3.2 1B has downloadable open weights; the other is API-only.

Side by side

Llama 3.2 1B and Mercury 2.5 specifications
Llama 3.2 1BMercury 2.5
ProviderMetaInception
Noometry Index20.133.5
Released2024-09-242026-09-08
WeightsOpenProprietary
Context window60K260K
Max output54K66K
Input $ / M tokens$0.027$0.04
Output $ / M tokens$0.20$0.15
Results tracked224

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mercury 2.5 leads

Llama 3.2 1B: 21.1 (#338), Mercury 2.5: 39.5 (#156)

Coding benchmarks
BenchmarkLlama 3.2 1BMercury 2.5
SciCode—38.5%
BigCodeBench Instruct8.2%—
LMArena Coding1070—
BigCodeBench Complete11.3%—
ALE-Bench—301.65

Agentic & Tool Use Not comparable

Llama 3.2 1B: 14.6 (#150), Mercury 2.5: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 1BMercury 2.5
Berkeley Function Calling Leaderboard10.8%—
BALROG6.6%—

Reasoning Mercury 2.5 leads

Llama 3.2 1B: 16.2 (#308), Mercury 2.5: 22.4 (#193)

Reasoning benchmarks
BenchmarkLlama 3.2 1BMercury 2.5
CritPt—0%
Chess Puzzles0%—
LMArena Hard Prompts1044—
Epoch Capabilities Index101.99—

Math Mercury 2.5 leads

Llama 3.2 1B: 10.4 (#313), Mercury 2.5: 23.3 (#272)

Math benchmarks
BenchmarkLlama 3.2 1BMercury 2.5
OTIS Mock AIME 2024-20250.6%—
ProofBench—3%
LMArena Math1086—

Knowledge Not comparable

Llama 3.2 1B: 7.2 (#312), Mercury 2.5: —

Knowledge benchmarks
BenchmarkLlama 3.2 1BMercury 2.5
GPQA Diamond23.9%—
LMArena Expert1007—

Multilingual Not comparable

Llama 3.2 1B: 23.8 (#292), Mercury 2.5: —

Multilingual benchmarks
BenchmarkLlama 3.2 1BMercury 2.5
LMArena Non-English973—
LMArena Chinese959—
LMArena German1014—
LMArena Russian941—

Instruction Following Not comparable

Llama 3.2 1B: 52.4 (#290), Mercury 2.5: —

Instruction Following benchmarks
BenchmarkLlama 3.2 1BMercury 2.5
LMArena Instruction Following1031—

Long Context Not comparable

Llama 3.2 1B: 31.9 (#274), Mercury 2.5: —

Long Context benchmarks
BenchmarkLlama 3.2 1BMercury 2.5
LMArena Longer Query1050—

Writing & Preference Not comparable

Llama 3.2 1B: 21.3 (#310), Mercury 2.5: —

Writing & Preference benchmarks
BenchmarkLlama 3.2 1BMercury 2.5
LMArena Text1055—
LMArena Creative Writing1033—
EQ-Bench Creative Writing200—
LMArena Multi-Turn1030—

Frequently asked questions

Is Llama 3.2 1B better than Mercury 2.5?

Mercury 2.5 is the stronger model overall, scoring 33.5 to 20.1 on the Noometry Index.

Which is cheaper, Llama 3.2 1B or Mercury 2.5?

Mercury 2.5 is cheaper. It lists at $0.04 per million input tokens and $0.15 per million output tokens; Llama 3.2 1B lists at $0.027 and $0.20.

Is Llama 3.2 1B or Mercury 2.5 better for coding?

Mercury 2.5 scores higher on coding benchmarks: 39.5 versus 21.1 in the Noometry coding category.

Which has the bigger context window?

Mercury 2.5 does, with 260K tokens against 60K.

How many benchmarks do Llama 3.2 1B and Mercury 2.5 share?

0 benchmarks have published results for both models. Llama 3.2 1B has 22 scored results on Noometry and Mercury 2.5 has 4.

Related comparisons

Go deeper