Noometry

Model comparison

Command A vs Grok-2 (Dec 2024)

Command A is the stronger model overall, scoring 36.5 to 33.7 on the Noometry Index.

Last verified . 18 shared benchmarks.

Command A Cohere

36.5

Rank #215 Confirmed

Grok-2 (Dec 2024) xAI

33.7

Rank #239 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Command A scores higher in 6 categories and Grok-2 (Dec 2024) in 2 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Command A leads 36.2 to 20.8.
  • Command A has downloadable open weights; the other is API-only.

Side by side

Command AGrok-2 (Dec 2024)
ProviderCoherexAI
Noometry Index36.533.7
Released2025-03-132024-08-13
WeightsOpenProprietary
Context window256K—
Max output8K—
Input $ / M tokens$2.50—
Output $ / M tokens$10—
Results tracked2434

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok-2 (Dec 2024) leads

Command A: 27.2 (#322), Grok-2 (Dec 2024): 33.3 (#258)

BenchmarkCommand AGrok-2 (Dec 2024)
LMArena Coding13301287
Aider Polyglot12%—
WeirdML—22.2%
LiveBench Coding—46.4%

Agentic & Tool Use Not comparable

Command A: 35.9 (#40), Grok-2 (Dec 2024): —

BenchmarkCommand AGrok-2 (Dec 2024)
Berkeley Function Calling Leaderboard57.1%—

Reasoning Command A leads

Command A: 18.3 (#283), Grok-2 (Dec 2024): 16.9 (#299)

BenchmarkCommand AGrok-2 (Dec 2024)
LMArena Hard Prompts13261272
DTBench61.3%65.2%
SimpleBench—22.7%
Kagi LLM Benchmark28.8%—
LiveBench Reasoning—54.8%
LiveBench Data Analysis—54.5%
LMCA10.3%—
Epoch Capabilities Index—130.48
LiveBench—54.3%

Math Command A leads

Command A: 36.2 (#171), Grok-2 (Dec 2024): 20.8 (#284)

BenchmarkCommand AGrok-2 (Dec 2024)
LMArena Math13001283
OTIS Mock AIME 2024-2025—11.5%
LiveBench Math—54.9%
MATH Level 5—63.5%
FrontierMath (Feb 2025 set)—0.7%

Knowledge Command A leads

Command A: 37.1 (#159), Grok-2 (Dec 2024): 29.8 (#233)

BenchmarkCommand AGrok-2 (Dec 2024)
LMArena Expert12951254
GPQA Diamond—53.8%
Confabulations—20.1%
Vectara Hallucination Rate9.3%—

Multilingual Command A leads

Command A: 45.3 (#170), Grok-2 (Dec 2024): 43.1 (#188)

BenchmarkCommand AGrok-2 (Dec 2024)
LMArena Non-English13131282
LMArena Chinese13271289
LMArena French13511318
LMArena German13411287
LMArena Japanese12851244
LMArena Korean12851237
LMArena Russian13141286
LMArena Spanish13471281

Instruction Following Command A leads

Command A: 69.1 (#177), Grok-2 (Dec 2024): 66.9 (#202)

BenchmarkCommand AGrok-2 (Dec 2024)
LMArena Instruction Following13091270
LiveBench Instruction Following—69.6%

Long Context Command A leads

Command A: 40.6 (#151), Grok-2 (Dec 2024): 38.8 (#190)

BenchmarkCommand AGrok-2 (Dec 2024)
LMArena Longer Query13341276

Writing & Preference Grok-2 (Dec 2024) leads

Command A: 47.6 (#208), Grok-2 (Dec 2024): 48.6 (#198)

BenchmarkCommand AGrok-2 (Dec 2024)
LMArena Text13311305
LMArena Creative Writing13191284
LMArena Multi-Turn13391290
Short-Story Creative Writing—63.6%
EQ-Bench Creative Writing1145—
LiveBench Language—45.6%

Frequently asked questions

Is Command A better than Grok-2 (Dec 2024)?

Command A is the stronger model overall, scoring 36.5 to 33.7 on the Noometry Index.

Is Command A or Grok-2 (Dec 2024) better for coding?

Grok-2 (Dec 2024) scores higher on coding benchmarks: 33.3 versus 27.2 in the Noometry coding category.

How many benchmarks do Command A and Grok-2 (Dec 2024) share?

18 benchmarks have published results for both models. Command A has 24 scored results on Noometry and Grok-2 (Dec 2024) has 34.

Related comparisons

Go deeper