Model comparison

Llama2 70b Steerlm Chat vs Mercury 2.5

Llama2 70b Steerlm Chat has enough public results to be ranked (#265); Mercury 2.5 does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Llama2 70b Steerlm Chat NVIDIA

31.2

Rank #265 Confirmed

Mercury 2.5 Inception

30.2

Unranked Sparse

Summary

  • The widest gap is in math, where Llama2 70b Steerlm Chat leads 28.8 to 22.4.
  • Llama2 70b Steerlm Chat has downloadable open weights; the other is API-only.

Side by side

Llama2 70b Steerlm Chat and Mercury 2.5 specifications
Llama2 70b Steerlm ChatMercury 2.5
ProviderNVIDIAInception
Noometry Index31.230.2
Released—2026-09-08
WeightsOpenProprietary
Context window—260K
Max output—66K
Input $ / M tokens—$0.04
Output $ / M tokens—$0.15
Results tracked92

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama2 70b Steerlm Chat: 29.3 (#295), Mercury 2.5: —

Coding benchmarks
BenchmarkLlama2 70b Steerlm ChatMercury 2.5
LMArena Coding1025—
ALE-Bench—301.65

Reasoning Not comparable

Llama2 70b Steerlm Chat: 19.1 (#245), Mercury 2.5: —

Reasoning benchmarks
BenchmarkLlama2 70b Steerlm ChatMercury 2.5
LMArena Hard Prompts1047—

Math Llama2 70b Steerlm Chat leads

Llama2 70b Steerlm Chat: 28.8 (#223), Mercury 2.5: 22.4

Math benchmarks
BenchmarkLlama2 70b Steerlm ChatMercury 2.5
ProofBench—3%
LMArena Math1072—

Multilingual Not comparable

Llama2 70b Steerlm Chat: 28.9 (#265), Mercury 2.5: —

Multilingual benchmarks
BenchmarkLlama2 70b Steerlm ChatMercury 2.5
LMArena Non-English1064—

Instruction Following Not comparable

Llama2 70b Steerlm Chat: 54.5 (#274), Mercury 2.5: —

Instruction Following benchmarks
BenchmarkLlama2 70b Steerlm ChatMercury 2.5
LMArena Instruction Following1061—

Long Context Not comparable

Llama2 70b Steerlm Chat: 30.4 (#283), Mercury 2.5: —

Long Context benchmarks
BenchmarkLlama2 70b Steerlm ChatMercury 2.5
LMArena Longer Query998—

Writing & Preference Not comparable

Llama2 70b Steerlm Chat: 31.8 (#278), Mercury 2.5: —

Writing & Preference benchmarks
BenchmarkLlama2 70b Steerlm ChatMercury 2.5
LMArena Text1098—
LMArena Creative Writing1091—
LMArena Multi-Turn1058—

Frequently asked questions

Is Llama2 70b Steerlm Chat better than Mercury 2.5?

Llama2 70b Steerlm Chat has enough public results to be ranked (#265); Mercury 2.5 does not yet, so treat this comparison as directional.

How many benchmarks do Llama2 70b Steerlm Chat and Mercury 2.5 share?

0 benchmarks have published results for both models. Llama2 70b Steerlm Chat has 9 scored results on Noometry and Mercury 2.5 has 2.

Related comparisons

Go deeper