Model comparison

Claude 2.1 vs Grok 4.7

Grok 4.7 is the stronger model overall, scoring 53.1 to 25.2 on the Noometry Index.

Last verified . 4 shared benchmarks.

Claude 2.1 Anthropic

25.2

Rank #345 Reported

Grok 4.7 xAI

53.1

Rank #37 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Claude 2.1 scores higher in 0 categories and Grok 4.7 in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Grok 4.7 leads 57.8 to 10.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.9% for Claude 2.1 and 98.1% for Grok 4.7.

Side by side

Claude 2.1 and Grok 4.7 specifications
Claude 2.1Grok 4.7
ProviderAnthropicxAI
Noometry Index25.253.1
Released2023-11-212026-09-21
WeightsProprietaryProprietary
Context window—500K
Max output—500K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked739

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.7 leads

Claude 2.1: 26.2 (#327), Grok 4.7: 58.0 (#18)

Coding benchmarks
BenchmarkClaude 2.1Grok 4.7
FrontierCode—47.6%
CursorBench—46.3%
LMArena WebDev—1639
FrontierSWE—29.5%
SciCode—57.8%
WeirdML7.1%—
LMArena Coding—1427

Agentic & Tool Use Not comparable

Claude 2.1: —, Grok 4.7: 36.7 (#37)

Agentic & Tool Use benchmarks
BenchmarkClaude 2.1Grok 4.7
APEX-Agents—54.6%
GDP.pdf—22.8%
Vending-Bench 2—10,537

Reasoning Grok 4.7 leads

Claude 2.1: 21.4 (#221), Grok 4.7: 49.1 (#40)

Reasoning benchmarks
BenchmarkClaude 2.1Grok 4.7
DTBench51%96%
Epoch Capabilities Index119.27153.53
NYT Connections (extended)—76.8%
CritPt—18%
Chess Puzzles—38%
LMArena Hard Prompts—1413
Mystery Game Puzzles—29%
LMCA—49.4%
ForecastBench54.2—

Math Grok 4.7 leads

Claude 2.1: 10.2 (#315), Grok 4.7: 57.8 (#39)

Math benchmarks
BenchmarkClaude 2.1Grok 4.7
OTIS Mock AIME 2024-20251.9%98.1%
FrontierMath (Tiers 1-3)—53%
FrontierMath Tier 4—17.1%
ProofBench—34%
LMArena Math—1407

Knowledge Grok 4.7 leads

Claude 2.1: 15.4 (#292), Grok 4.7: 62.8 (#22)

Knowledge benchmarks
BenchmarkClaude 2.1Grok 4.7
GPQA Diamond33%92.7%
SimpleQA Verified—56%
LMArena Expert—1422
MMLU73.5%—

Multimodal Not comparable

Claude 2.1: —, Grok 4.7: 35.5 (#87)

Multimodal benchmarks
BenchmarkClaude 2.1Grok 4.7
LMArena Vision—1228
Blueprint-Bench 2—32.5%
Furniture Assembly—20.8%

Multilingual Not comparable

Claude 2.1: —, Grok 4.7: 50.8 (#116)

Multilingual benchmarks
BenchmarkClaude 2.1Grok 4.7
LMArena Non-English—1389
LMArena Chinese—1455
LMArena French—1455
LMArena Russian—1397
LMArena Spanish—1400

Instruction Following Not comparable

Claude 2.1: —, Grok 4.7: 74.1 (#105)

Instruction Following benchmarks
BenchmarkClaude 2.1Grok 4.7
LMArena Instruction Following—1404

Long Context Not comparable

Claude 2.1: —, Grok 4.7: 43.1 (#104)

Long Context benchmarks
BenchmarkClaude 2.1Grok 4.7
LMArena Longer Query—1413

Writing & Preference Not comparable

Claude 2.1: —, Grok 4.7: 70.0 (#24)

Writing & Preference benchmarks
BenchmarkClaude 2.1Grok 4.7
LMArena Text—1399
LMArena Creative Writing—1391
EQ-Bench Creative Writing—2007
LMArena Multi-Turn—1393

Frequently asked questions

Is Claude 2.1 better than Grok 4.7?

Grok 4.7 is the stronger model overall, scoring 53.1 to 25.2 on the Noometry Index.

Is Claude 2.1 or Grok 4.7 better for coding?

Grok 4.7 scores higher on coding benchmarks: 58.0 versus 26.2 in the Noometry coding category.

How many benchmarks do Claude 2.1 and Grok 4.7 share?

4 benchmarks have published results for both models. Claude 2.1 has 7 scored results on Noometry and Grok 4.7 has 39.

Related comparisons

Go deeper