Noometry

Model comparison

DeepSeek-V2.5 (Sep 2024) vs Grok 4.20 Multi-Agent

Grok 4.20 Multi-Agent is the stronger model overall, scoring 46.2 to 37.6 on the Noometry Index.

Last verified . 17 shared benchmarks.

DeepSeek-V2.5 (Sep 2024) DeepSeek

37.6

Rank #200 Confirmed

Grok 4.20 Multi-Agent xAI

46.2

Rank #65 Confirmed

Summary

  • They share 17 benchmarks with published results for both. DeepSeek-V2.5 (Sep 2024) scores higher in 0 categories and Grok 4.20 Multi-Agent in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.20 Multi-Agent leads 43.9 to 25.6.
  • DeepSeek-V2.5 (Sep 2024) has downloadable open weights; the other is API-only.

Side by side

DeepSeek-V2.5 (Sep 2024)Grok 4.20 Multi-Agent
ProviderDeepSeekxAI
Noometry Index37.646.2
Released2024-09-062026-03-09
WeightsOpenProprietary
Context window—1M
Max output—30K
Input $ / M tokens—$1.25
Output $ / M tokens—$2.50
Results tracked2220

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.20 Multi-Agent leads

DeepSeek-V2.5 (Sep 2024): 31.7 (#281), Grok 4.20 Multi-Agent: 43.0 (#92)

BenchmarkDeepSeek-V2.5 (Sep 2024)Grok 4.20 Multi-Agent
LMArena Coding13091457
Aider Polyglot17.8%—
BigCodeBench Instruct48.6%—
BigCodeBench Complete53.2%—
HumanEval+83.5%—
MBPP+74.1%—

Agentic & Tool Use Not comparable

DeepSeek-V2.5 (Sep 2024): —, Grok 4.20 Multi-Agent: —

BenchmarkDeepSeek-V2.5 (Sep 2024)Grok 4.20 Multi-Agent
LMArena Search—1204

Reasoning Grok 4.20 Multi-Agent leads

DeepSeek-V2.5 (Sep 2024): 25.6 (#145), Grok 4.20 Multi-Agent: 43.9 (#48)

BenchmarkDeepSeek-V2.5 (Sep 2024)Grok 4.20 Multi-Agent
LMArena Hard Prompts12891448
NYT Connections (extended)—89.6%

Math Grok 4.20 Multi-Agent leads

DeepSeek-V2.5 (Sep 2024): 35.9 (#177), Grok 4.20 Multi-Agent: 39.4 (#104)

BenchmarkDeepSeek-V2.5 (Sep 2024)Grok 4.20 Multi-Agent
LMArena Math12881442

Knowledge Grok 4.20 Multi-Agent leads

DeepSeek-V2.5 (Sep 2024): 34.8 (#193), Grok 4.20 Multi-Agent: 40.4 (#119)

BenchmarkDeepSeek-V2.5 (Sep 2024)Grok 4.20 Multi-Agent
LMArena Expert12661445

Multimodal Not comparable

DeepSeek-V2.5 (Sep 2024): —, Grok 4.20 Multi-Agent: 40.5 (#48)

BenchmarkDeepSeek-V2.5 (Sep 2024)Grok 4.20 Multi-Agent
LMArena Vision—1259

Multilingual Grok 4.20 Multi-Agent leads

DeepSeek-V2.5 (Sep 2024): 42.5 (#193), Grok 4.20 Multi-Agent: 54.4 (#43)

BenchmarkDeepSeek-V2.5 (Sep 2024)Grok 4.20 Multi-Agent
LMArena Non-English12731440
LMArena Chinese13181475
LMArena French12891466
LMArena German12581456
LMArena Japanese12281405
LMArena Korean12091416
LMArena Russian12891457
LMArena Spanish12481447

Instruction Following Grok 4.20 Multi-Agent leads

DeepSeek-V2.5 (Sep 2024): 67.5 (#194), Grok 4.20 Multi-Agent: 74.8 (#84)

BenchmarkDeepSeek-V2.5 (Sep 2024)Grok 4.20 Multi-Agent
LMArena Instruction Following12801420

Long Context Grok 4.20 Multi-Agent leads

DeepSeek-V2.5 (Sep 2024): 39.5 (#174), Grok 4.20 Multi-Agent: 43.7 (#88)

BenchmarkDeepSeek-V2.5 (Sep 2024)Grok 4.20 Multi-Agent
LMArena Longer Query13011431

Writing & Preference Grok 4.20 Multi-Agent leads

DeepSeek-V2.5 (Sep 2024): 49.8 (#187), Grok 4.20 Multi-Agent: 64.0 (#59)

BenchmarkDeepSeek-V2.5 (Sep 2024)Grok 4.20 Multi-Agent
LMArena Text12941450
LMArena Creative Writing12851436
LMArena Multi-Turn12971452

Frequently asked questions

Is DeepSeek-V2.5 (Sep 2024) better than Grok 4.20 Multi-Agent?

Grok 4.20 Multi-Agent is the stronger model overall, scoring 46.2 to 37.6 on the Noometry Index.

Is DeepSeek-V2.5 (Sep 2024) or Grok 4.20 Multi-Agent better for coding?

Grok 4.20 Multi-Agent scores higher on coding benchmarks: 43.0 versus 31.7 in the Noometry coding category.

How many benchmarks do DeepSeek-V2.5 (Sep 2024) and Grok 4.20 Multi-Agent share?

17 benchmarks have published results for both models. DeepSeek-V2.5 (Sep 2024) has 22 scored results on Noometry and Grok 4.20 Multi-Agent has 20.

Related comparisons

Go deeper