Model comparison

Command A vs Llama2 70b Steerlm Chat

Command A is the stronger model overall, scoring 36.5 to 31.8 on the Noometry Index.

Last verified . 9 shared benchmarks.

Command A Cohere

36.5

Rank #215 Confirmed

Llama2 70b Steerlm Chat NVIDIA

31.8

Rank #268 Confirmed

Summary

  • They share 9 benchmarks with published results for both. Command A scores higher in 5 categories and Llama2 70b Steerlm Chat in 2 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where Command A leads 45.3 to 28.8.

Side by side

Command A and Llama2 70b Steerlm Chat specifications
Command ALlama2 70b Steerlm Chat
ProviderCohereNVIDIA
Noometry Index36.531.8
Released2025-03-13—
WeightsOpenOpen
Context window256K—
Max output8K—
Input $ / M tokens$2.50—
Output $ / M tokens$10—
Results tracked249

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Llama2 70b Steerlm Chat leads

Command A: 27.2 (#322), Llama2 70b Steerlm Chat: 29.9 (#300)

Coding benchmarks
BenchmarkCommand ALlama2 70b Steerlm Chat
LMArena Coding13301025
Aider Polyglot12%—

Agentic & Tool Use Not comparable

Command A: 35.9 (#40), Llama2 70b Steerlm Chat: —

Agentic & Tool Use benchmarks
BenchmarkCommand ALlama2 70b Steerlm Chat
Berkeley Function Calling Leaderboard57.1%—

Reasoning Llama2 70b Steerlm Chat leads

Command A: 18.3 (#283), Llama2 70b Steerlm Chat: 20.0 (#246)

Reasoning benchmarks
BenchmarkCommand ALlama2 70b Steerlm Chat
LMArena Hard Prompts13261047
Kagi LLM Benchmark28.8%—
DTBench61.3%—
LMCA10.3%—

Math Command A leads

Command A: 36.2 (#171), Llama2 70b Steerlm Chat: 31.3 (#226)

Math benchmarks
BenchmarkCommand ALlama2 70b Steerlm Chat
LMArena Math13001072

Knowledge Not comparable

Command A: 37.1 (#159), Llama2 70b Steerlm Chat: —

Knowledge benchmarks
BenchmarkCommand ALlama2 70b Steerlm Chat
Vectara Hallucination Rate9.3%—
LMArena Expert1295—

Multilingual Command A leads

Command A: 45.3 (#170), Llama2 70b Steerlm Chat: 28.8 (#270)

Multilingual benchmarks
BenchmarkCommand ALlama2 70b Steerlm Chat
LMArena Non-English13131063
LMArena Chinese1327—
LMArena French1351—
LMArena German1341—
LMArena Japanese1285—
LMArena Korean1285—
LMArena Russian1314—
LMArena Spanish1347—

Instruction Following Command A leads

Command A: 69.1 (#177), Llama2 70b Steerlm Chat: 54.2 (#279)

Instruction Following benchmarks
BenchmarkCommand ALlama2 70b Steerlm Chat
LMArena Instruction Following13091060

Long Context Command A leads

Command A: 40.6 (#151), Llama2 70b Steerlm Chat: 30.4 (#288)

Long Context benchmarks
BenchmarkCommand ALlama2 70b Steerlm Chat
LMArena Longer Query1334998

Writing & Preference Command A leads

Command A: 47.6 (#208), Llama2 70b Steerlm Chat: 31.6 (#283)

Writing & Preference benchmarks
BenchmarkCommand ALlama2 70b Steerlm Chat
LMArena Text13311098
LMArena Creative Writing13191091
LMArena Multi-Turn13391058
EQ-Bench Creative Writing1145—

Frequently asked questions

Is Command A better than Llama2 70b Steerlm Chat?

Command A is the stronger model overall, scoring 36.5 to 31.8 on the Noometry Index.

Is Command A or Llama2 70b Steerlm Chat better for coding?

Llama2 70b Steerlm Chat scores higher on coding benchmarks: 29.9 versus 27.2 in the Noometry coding category.

How many benchmarks do Command A and Llama2 70b Steerlm Chat share?

9 benchmarks have published results for both models. Command A has 24 scored results on Noometry and Llama2 70b Steerlm Chat has 9.

Related comparisons

Go deeper