Noometry

Model comparison

Claude 3.5 Sonnet vs Grok 4.7

Grok 4.7 is the stronger model overall, scoring 46.6 to 34.4 on the Noometry Index.

Last verified . 13 shared benchmarks.

Claude 3.5 Sonnet Anthropic

34.4

Rank #225 Confirmed

Grok 4.7 xAI

46.6

Rank #56 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Claude 3.5 Sonnet scores higher in 0 categories and Grok 4.7 in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Grok 4.7 leads 41.1 to 18.0.

Side by side

Claude 3.5 SonnetGrok 4.7
ProviderAnthropicxAI
Noometry Index34.446.6
Released2024-06-202026-09-21
WeightsProprietaryProprietary
Context window—500K
Max output—500K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked6021

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.7 leads

Claude 3.5 Sonnet: 39.5 (#145), Grok 4.7: 55.0 (#23)

BenchmarkClaude 3.5 SonnetGrok 4.7
LMArena Coding13431423
Aider Polyglot51.6%—
CursorBench—46.3%
LMArena WebDev—1636
FrontierSWE—29.5%
SciCode—57.4%
GSO4.6%—
WeirdML40%—
BigCodeBench Instruct46.8%—
LiveBench Coding67.1%—
BigCodeBench Complete58.6%—
CadEval48%—
HumanEval+81.7%—
MBPP+74.3%—

Agentic & Tool Use Not comparable

Claude 3.5 Sonnet: 32.1 (#61), Grok 4.7: —

BenchmarkClaude 3.5 SonnetGrok 4.7
TheAgentCompany24%—
Cybench17.5%—
BALROG32.6%—
METR Time Horizons45.2%—

Reasoning Grok 4.7 leads

Claude 3.5 Sonnet: 22.5 (#176), Grok 4.7: 40.1 (#49)

BenchmarkClaude 3.5 SonnetGrok 4.7
LMArena Hard Prompts13051409
SimpleBench41.4%—
NYT Connections (extended)—76.8%
CritPt—17.7%
EnigmaEval0.9%—
LiveBench Reasoning56.7%—
DTBench67.8%—
LiveBench Data Analysis55%—
Epoch Capabilities Index133.55—
ForecastBench60.7—
LiveBench59%—

Math Grok 4.7 leads

Claude 3.5 Sonnet: 18.0 (#282), Grok 4.7: 41.1 (#73)

BenchmarkClaude 3.5 SonnetGrok 4.7
LMArena Math13061393
OTIS Mock AIME 2024-20258.5%—
ProofBench—34%
Omni-MATH27.6%—
LiveBench Math52.3%—
MATH Level 556.9%—
FrontierMath (Feb 2025 set)2.1%—
FrontierMath Tier 4 (v1)0%—

Knowledge Grok 4.7 leads

Claude 3.5 Sonnet: 28.5 (#236), Grok 4.7: 38.7 (#130)

BenchmarkClaude 3.5 SonnetGrok 4.7
LMArena Expert12641413
GPQA Diamond55.3%—
Humanity's Last Exam4.1%—
MMLU-Pro77.7%—
Confabulations19.9%—
GPQA (HELM)56.5%—
MMLU87.3%—

Multimodal Grok 4.7 leads

Claude 3.5 Sonnet: 26.0 (#115), Grok 4.7: 28.8 (#107)

BenchmarkClaude 3.5 SonnetGrok 4.7
LMArena Vision1125—
Video-MME60%—
GeoBench62%—
VPCT33%—
Furniture Assembly—20.8%

Multilingual Grok 4.7 leads

Claude 3.5 Sonnet: 43.4 (#180), Grok 4.7: 51.2 (#108)

BenchmarkClaude 3.5 SonnetGrok 4.7
LMArena Non-English12831392
LMArena Chinese12711476
LMArena Russian13051396
LMArena French1304—
LMArena German1297—
LMArena Japanese1234—
LMArena Korean1200—
LMArena Spanish1289—

Instruction Following Grok 4.7 leads

Claude 3.5 Sonnet: 69.0 (#177), Grok 4.7: 74.3 (#98)

BenchmarkClaude 3.5 SonnetGrok 4.7
LMArena Instruction Following12971406
LiveBench Instruction Following69.3%—
IFEval85.5%—

Long Context Grok 4.7 leads

Claude 3.5 Sonnet: 39.9 (#162), Grok 4.7: 43.2 (#97)

BenchmarkClaude 3.5 SonnetGrok 4.7
LMArena Longer Query13111416

Writing & Preference Grok 4.7 leads

Claude 3.5 Sonnet: 53.0 (#159), Grok 4.7: 70.1 (#23)

BenchmarkClaude 3.5 SonnetGrok 4.7
LMArena Text12981397
LMArena Creative Writing12921391
EQ-Bench Creative Writing14512007
LMArena Multi-Turn13261389
Short-Story Creative Writing80.3%—
WildBench79.2%—
LiveBench Language53.8%—

Frequently asked questions

Is Claude 3.5 Sonnet better than Grok 4.7?

Grok 4.7 is the stronger model overall, scoring 46.6 to 34.4 on the Noometry Index.

Is Claude 3.5 Sonnet or Grok 4.7 better for coding?

Grok 4.7 scores higher on coding benchmarks: 55.0 versus 39.5 in the Noometry coding category.

How many benchmarks do Claude 3.5 Sonnet and Grok 4.7 share?

13 benchmarks have published results for both models. Claude 3.5 Sonnet has 60 scored results on Noometry and Grok 4.7 has 21.

Related comparisons

Go deeper