Noometry

Model comparison

Command A vs GPT-4.1 mini

Command A is the stronger model overall, scoring 36.5 to 33.6 on the Noometry Index. GPT-4.1 mini costs 6.2× less per token, which makes it the better buy when Command A's lead doesn't matter for your workload.

Last verified . 23 shared benchmarks.

Command A Cohere

36.5

Rank #215 Confirmed

GPT-4.1 mini OpenAI

33.6

Rank #240 Confirmed

Summary

  • They share 23 benchmarks with published results for both. Command A scores higher in 5 categories and GPT-4.1 mini in 4 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Command A leads 36.2 to 24.1.
  • The biggest single-benchmark swing is Aider Polyglot: 12% for Command A and 32.4% for GPT-4.1 mini.
  • GPT-4.1 mini is cheaper at $0.40 / $1.60 per million input/output tokens, against $2.50 / $10 for Command A.
  • GPT-4.1 mini accepts more context: 1.05M tokens versus 256K.
  • Command A has downloadable open weights; the other is API-only.

Side by side

Command AGPT-4.1 mini
ProviderCohereOpenAI
Noometry Index36.533.6
Released2025-03-132025-04-14
WeightsOpenProprietary
Context window256K1.05M
Max output8K33K
Input $ / M tokens$2.50$0.40
Output $ / M tokens$10$1.60
Results tracked2447

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-4.1 mini leads

Command A: 27.2 (#322), GPT-4.1 mini: 30.6 (#293)

BenchmarkCommand AGPT-4.1 mini
Aider Polyglot12%32.4%
LMArena Coding13301367
SWE-bench Verified (bash only)—23.9%
SciCode—40.4%
WeirdML—37.6%
BigCodeBench Instruct—48.9%
CadEval—16%

Agentic & Tool Use Command A leads

Command A: 35.9 (#40), GPT-4.1 mini: 33.3 (#55)

BenchmarkCommand AGPT-4.1 mini
Berkeley Function Calling Leaderboard57.1%50.5%

Reasoning Command A leads

Command A: 18.3 (#283), GPT-4.1 mini: 10.8 (#340)

BenchmarkCommand AGPT-4.1 mini
Kagi LLM Benchmark28.8%48.6%
LMArena Hard Prompts13261349
DTBench61.3%68.8%
LMCA10.3%21.1%
ARC-AGI-2—0%
ARC-AGI-1—3.5%
CritPt—0%
Chess Puzzles—7%
Mystery Game Puzzles—7%
Epoch Capabilities Index—135.01

Math Command A leads

Command A: 36.2 (#171), GPT-4.1 mini: 24.1 (#270)

BenchmarkCommand AGPT-4.1 mini
LMArena Math13001343
FrontierMath (Tiers 1-3)—6.7%
OTIS Mock AIME 2024-2025—44.7%
Omni-MATH—49.1%
MATH Level 5—87.3%
FrontierMath (Feb 2025 set)—4.5%

Knowledge Command A leads

Command A: 37.1 (#159), GPT-4.1 mini: 34.7 (#194)

BenchmarkCommand AGPT-4.1 mini
LMArena Expert12951338
GPQA Diamond—65.8%
SimpleQA Verified—12.7%
MMLU-Pro—78.3%
Vectara Hallucination Rate9.3%—
GPQA (HELM)—61.4%

Multimodal Not comparable

Command A: —, GPT-4.1 mini: 35.8 (#82)

BenchmarkCommand AGPT-4.1 mini
LMArena Vision—1181

Multilingual Too close to call

Command A: 45.3 (#170), GPT-4.1 mini: 45.7 (#166)

BenchmarkCommand AGPT-4.1 mini
LMArena Non-English13131318
LMArena Chinese13271329
LMArena French13511358
LMArena German13411351
LMArena Japanese12851290
LMArena Korean12851298
LMArena Russian13141324
LMArena Spanish13471319

Instruction Following GPT-4.1 mini leads

Command A: 69.1 (#177), GPT-4.1 mini: 73.7 (#118)

BenchmarkCommand AGPT-4.1 mini
LMArena Instruction Following13091333
IFEval—90.4%

Long Context Command A leads

Command A: 40.6 (#151), GPT-4.1 mini: 31.8 (#275)

BenchmarkCommand AGPT-4.1 mini
LMArena Longer Query13341344
Fiction.LiveBench—44.4%

Writing & Preference GPT-4.1 mini leads

Command A: 47.6 (#208), GPT-4.1 mini: 48.6 (#199)

BenchmarkCommand AGPT-4.1 mini
LMArena Text13311340
LMArena Creative Writing13191300
EQ-Bench Creative Writing11451147
LMArena Multi-Turn13391354
WildBench—83.8%

Frequently asked questions

Is Command A better than GPT-4.1 mini?

Command A is the stronger model overall, scoring 36.5 to 33.6 on the Noometry Index. GPT-4.1 mini costs 6.2× less per token, which makes it the better buy when Command A's lead doesn't matter for your workload.

Which is cheaper, Command A or GPT-4.1 mini?

GPT-4.1 mini is cheaper. It lists at $0.40 per million input tokens and $1.60 per million output tokens; Command A lists at $2.50 and $10.

Is Command A or GPT-4.1 mini better for coding?

GPT-4.1 mini scores higher on coding benchmarks: 30.6 versus 27.2 in the Noometry coding category.

Which has the bigger context window?

GPT-4.1 mini does, with 1.05M tokens against 256K.

How many benchmarks do Command A and GPT-4.1 mini share?

23 benchmarks have published results for both models. Command A has 24 scored results on Noometry and GPT-4.1 mini has 47.

Related comparisons

Go deeper