Noometry

Model comparison

DeepSeek LLM 67B vs Grok 4.1 Fast

Grok 4.1 Fast is the stronger model overall, scoring 40.9 to 24.8 on the Noometry Index.

Last verified . 10 shared benchmarks.

DeepSeek LLM 67B DeepSeek

24.8

Rank #341 Confirmed

Grok 4.1 Fast xAI

40.9

Rank #131 Confirmed

Summary

  • They share 10 benchmarks with published results for both. DeepSeek LLM 67B scores higher in 0 categories and Grok 4.1 Fast in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.1 Fast leads 42.3 to 15.9.
  • DeepSeek LLM 67B has downloadable open weights; the other is API-only.

Side by side

DeepSeek LLM 67BGrok 4.1 Fast
ProviderDeepSeekxAI
Noometry Index24.840.9
Released2023-11-292025-06-27
WeightsOpenProprietary
Context window—128K
Max output—30K
Input $ / M tokens—$0.20
Output $ / M tokens—$0.50
Results tracked1532

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.1 Fast leads

DeepSeek LLM 67B: 31.3 (#273), Grok 4.1 Fast: 33.8 (#236)

BenchmarkDeepSeek LLM 67BGrok 4.1 Fast
LMArena Coding10961411
LMArena WebDev—1241
ALE-Bench—394.93

Agentic & Tool Use Not comparable

DeepSeek LLM 67B: —, Grok 4.1 Fast: 36.1 (#35)

BenchmarkDeepSeek LLM 67BGrok 4.1 Fast
Berkeley Function Calling Leaderboard—69.6%
τ²-bench Banking—13.1%
LMArena Search—1171
Vending-Bench 2—1,107

Reasoning Grok 4.1 Fast leads

DeepSeek LLM 67B: 15.9 (#300), Grok 4.1 Fast: 42.3 (#45)

BenchmarkDeepSeek LLM 67BGrok 4.1 Fast
LMArena Hard Prompts10701407
SimpleBench—56%
NYT Connections (extended)—87.4%
Chess Puzzles0%—
DTBench—87.7%
Epoch Capabilities Index110.54—
ForecastBench—61

Math Grok 4.1 Fast leads

DeepSeek LLM 67B: 8.1 (#318), Grok 4.1 Fast: 30.9 (#201)

BenchmarkDeepSeek LLM 67BGrok 4.1 Fast
LMArena Math11081408
MathArena Final-Answer Competitions—60.9%
OTIS Mock AIME 2024-20250.8%—
ProofBench—4%
MATH Level 56.4%—

Knowledge Grok 4.1 Fast leads

DeepSeek LLM 67B: 7.1 (#308), Grok 4.1 Fast: 32.6 (#203)

BenchmarkDeepSeek LLM 67BGrok 4.1 Fast
GPQA Diamond24.6%—
Vectara Hallucination Rate—17.8%
LMArena Expert—1398

Multimodal Not comparable

DeepSeek LLM 67B: —, Grok 4.1 Fast: 36.3 (#71)

BenchmarkDeepSeek LLM 67BGrok 4.1 Fast
LMArena Vision—1201

Multilingual Grok 4.1 Fast leads

DeepSeek LLM 67B: 29.5 (#262), Grok 4.1 Fast: 51.1 (#110)

BenchmarkDeepSeek LLM 67BGrok 4.1 Fast
LMArena Non-English10731391
LMArena Chinese11321441
LMArena French—1416
LMArena German—1404
LMArena Japanese—1347
LMArena Korean—1361
LMArena Russian—1387
LMArena Spanish—1411

Instruction Following Grok 4.1 Fast leads

DeepSeek LLM 67B: 55.7 (#272), Grok 4.1 Fast: 72.8 (#127)

BenchmarkDeepSeek LLM 67BGrok 4.1 Fast
LMArena Instruction Following10791376

Long Context Grok 4.1 Fast leads

DeepSeek LLM 67B: 33.1 (#260), Grok 4.1 Fast: 42.4 (#121)

BenchmarkDeepSeek LLM 67BGrok 4.1 Fast
LMArena Longer Query10921390

Writing & Preference Grok 4.1 Fast leads

DeepSeek LLM 67B: 31.8 (#277), Grok 4.1 Fast: 57.4 (#126)

BenchmarkDeepSeek LLM 67BGrok 4.1 Fast
LMArena Text11051408
LMArena Creative Writing10671394
LMArena Multi-Turn10821389
EQ-Bench Creative Writing—1327

Frequently asked questions

Is DeepSeek LLM 67B better than Grok 4.1 Fast?

Grok 4.1 Fast is the stronger model overall, scoring 40.9 to 24.8 on the Noometry Index.

Is DeepSeek LLM 67B or Grok 4.1 Fast better for coding?

Grok 4.1 Fast scores higher on coding benchmarks: 33.8 versus 31.3 in the Noometry coding category.

How many benchmarks do DeepSeek LLM 67B and Grok 4.1 Fast share?

10 benchmarks have published results for both models. DeepSeek LLM 67B has 15 scored results on Noometry and Grok 4.1 Fast has 32.

Related comparisons

Go deeper