Noometry

Model comparison

Claude 3.7 Sonnet vs Grok 4.1

Grok 4.1 is the stronger model overall, scoring 40.8 to 39.4 on the Noometry Index.

Last verified . 18 shared benchmarks.

Claude 3.7 Sonnet Anthropic

39.4

Rank #154 Confirmed

Grok 4.1 xAI

40.8

Rank #135 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Claude 3.7 Sonnet scores higher in 4 categories and Grok 4.1 in 5 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.1 leads 28.3 to 18.7.
  • The biggest single-benchmark swing is Cybench: 20% for Claude 3.7 Sonnet and 39% for Grok 4.1.

Side by side

Claude 3.7 SonnetGrok 4.1
ProviderAnthropicxAI
Noometry Index39.440.8
Released2025-02-242025-11-17
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked5819

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 41.1 (#120), Grok 4.1: 33.4 (#246)

BenchmarkClaude 3.7 SonnetGrok 4.1
LMArena Coding13611445
SWE-bench Verified61%—
SWE-bench Verified (bash only)52.8%—
Aider Polyglot64.9%—
LMArena WebDev—1214
GSO3.8%—
LiveBench Coding74.5%—
CadEval54%—

Agentic & Tool Use Too close to call

Claude 3.7 Sonnet: 33.9 (#46), Grok 4.1: 33.8 (#47)

BenchmarkClaude 3.7 SonnetGrok 4.1
Cybench20%39%
TheAgentCompany30.9%—
DeepResearch Bench43.6%—
OSWorld35.8%—
METR Time Horizons60%—

Reasoning Grok 4.1 leads

Claude 3.7 Sonnet: 18.7 (#252), Grok 4.1: 28.3 (#91)

BenchmarkClaude 3.7 SonnetGrok 4.1
LMArena Hard Prompts13331436
ARC-AGI-20.9%—
SimpleBench46.4%—
ARC-AGI-128.6%—
EnigmaEval4.2%—
LiveBench Reasoning87.8%—
LiveBench Data Analysis74%—
Epoch Capabilities Index141.16—
ForecastBench61.8—
LiveBench76.1%—

Math Too close to call

Claude 3.7 Sonnet: 35.7 (#137), Grok 4.1: 36.2 (#124)

BenchmarkClaude 3.7 SonnetGrok 4.1
LMArena Math13361422
OTIS Mock AIME 2024-202557.8%—
Omni-MATH33%—
LiveBench Math79%—
MATH Level 591.2%—
FrontierMath (Feb 2025 set)4.1%—

Knowledge Too close to call

Claude 3.7 Sonnet: 39.7 (#117), Grok 4.1: 38.9 (#129)

BenchmarkClaude 3.7 SonnetGrok 4.1
LMArena Expert13211417
GPQA Diamond79.7%—
Humanity's Last Exam8%—
MMLU-Pro78.4%—
Confabulations14.7%—
GPQA (HELM)60.8%—

Multimodal Not comparable

Claude 3.7 Sonnet: 33.1 (#90), Grok 4.1: —

BenchmarkClaude 3.7 SonnetGrok 4.1
LMArena Vision1169—
GeoBench68%—
VPCT39%—
SpatialViz-Bench33.9%—

Multilingual Grok 4.1 leads

Claude 3.7 Sonnet: 44.3 (#174), Grok 4.1: 53.6 (#64)

BenchmarkClaude 3.7 SonnetGrok 4.1
LMArena Non-English12961425
LMArena Chinese12991464
LMArena French13021448
LMArena German13011447
LMArena Japanese12681396
LMArena Korean12491407
LMArena Russian13111434
LMArena Spanish12991438

Instruction Following Too close to call

Claude 3.7 Sonnet: 73.1 (#120), Grok 4.1: 74.0 (#106)

BenchmarkClaude 3.7 SonnetGrok 4.1
LMArena Instruction Following13521400
LiveBench Instruction Following81.3%—
IFEval83.4%—

Long Context Claude 3.7 Sonnet leads

Claude 3.7 Sonnet: 50.2 (#10), Grok 4.1: 43.2 (#96)

BenchmarkClaude 3.7 SonnetGrok 4.1
LMArena Longer Query13731416
Fiction.LiveBench83.3%—

Writing & Preference Grok 4.1 leads

Claude 3.7 Sonnet: 54.6 (#145), Grok 4.1: 62.6 (#71)

BenchmarkClaude 3.7 SonnetGrok 4.1
LMArena Text13141437
LMArena Creative Writing13321411
LMArena Multi-Turn13391438
Short-Story Creative Writing81.1%—
EQ-Bench Creative Writing1412—
WildBench81.4%—
LiveBench Language59.9%—

Frequently asked questions

Is Claude 3.7 Sonnet better than Grok 4.1?

Grok 4.1 is the stronger model overall, scoring 40.8 to 39.4 on the Noometry Index.

Is Claude 3.7 Sonnet or Grok 4.1 better for coding?

Claude 3.7 Sonnet scores higher on coding benchmarks: 41.1 versus 33.4 in the Noometry coding category.

How many benchmarks do Claude 3.7 Sonnet and Grok 4.1 share?

18 benchmarks have published results for both models. Claude 3.7 Sonnet has 58 scored results on Noometry and Grok 4.1 has 19.

Related comparisons

Go deeper