Noometry

Model comparison

Claude Opus 4.1 vs Grok 3

Claude Opus 4.1 is the stronger model overall, scoring 41.0 to 39.9 on the Noometry Index.

Last verified . 27 shared benchmarks.

Claude Opus 4.1 Anthropic

41.0

Rank #142 Confirmed

Grok 3 xAI

39.9

Rank #157 Confirmed

Summary

  • They share 27 benchmarks with published results for both. Claude Opus 4.1 scores higher in 6 categories and Grok 3 in 3 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Claude Opus 4.1 leads 32.2 to 13.7.
  • The biggest single-benchmark swing is SimpleBench: 60% for Claude Opus 4.1 and 36.1% for Grok 3.

Side by side

Claude Opus 4.1Grok 3
ProviderAnthropicxAI
Noometry Index41.039.9
Released2025-08-052025-04-09
WeightsProprietaryProprietary
Context window200K—
Max output32K—
Input $ / M tokens$15—
Output $ / M tokens$75—
Results tracked4840

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 4.1 leads

Claude Opus 4.1: 44.4 (#73), Grok 3: 41.9 (#115)

BenchmarkClaude Opus 4.1Grok 3
WeirdML45.9%37.2%
LMArena Coding14791432
SWE-bench Verified73.3%—
Aider Polyglot—53.3%
LMArena WebDev1390—
ALE-Bench674.77—
AlgoTune1.34—

Agentic & Tool Use Claude Opus 4.1 leads

Claude Opus 4.1: 35.0 (#41), Grok 3: 30.5 (#76)

BenchmarkClaude Opus 4.1Grok 3
Terminal-Bench38%—
GDPval43.6%—
Cybench42%—
DeepResearch Bench48.3%—
BALROG—29.5%
LMArena Search1148—
METR Time Horizons66.8%—

Reasoning Claude Opus 4.1 leads

Claude Opus 4.1: 32.2 (#76), Grok 3: 13.7 (#333)

BenchmarkClaude Opus 4.1Grok 3
SimpleBench60%36.1%
LMArena Hard Prompts14431434
Epoch Capabilities Index144.12138.33
ARC-AGI-2—0%
Kagi LLM Benchmark—61.3%
ARC-AGI-1—5.5%
Chess Puzzles7%—
EnigmaEval7.2%—
EBR-Bench7.9%—
Mystery Game Puzzles21%—
DTBench80%—
LMCA37.1%—
ForecastBench62—

Math Grok 3 leads

Claude Opus 4.1: 22.3 (#277), Grok 3: 38.0 (#145)

BenchmarkClaude Opus 4.1Grok 3
OTIS Mock AIME 2024-202568.9%55.6%
LMArena Math14311391
FrontierMath (Feb 2025 set)7.2%3.8%
FrontierMath Tier 4 (v1)4.2%0%
FrontierMath (Tiers 1-3)12.6%—
FrontierMath Tier 42.4%—
Omni-MATH—46.4%
MATH Level 5—88.7%

Knowledge Grok 3 leads

Claude Opus 4.1: 42.0 (#101), Grok 3: 46.2 (#82)

BenchmarkClaude Opus 4.1Grok 3
GPQA Diamond77.3%75.8%
Confabulations17.1%14.2%
Vectara Hallucination Rate11.8%5.8%
LMArena Expert14391421
Humanity's Last Exam11.5%—
MMLU-Pro—78.8%
GPQA (HELM)—65%

Multimodal Not comparable

Claude Opus 4.1: 26.8 (#119), Grok 3: —

BenchmarkClaude Opus 4.1Grok 3
VPCT35%—

Multilingual Too close to call

Claude Opus 4.1: 52.0 (#95), Grok 3: 52.3 (#87)

BenchmarkClaude Opus 4.1Grok 3
LMArena Non-English14051410
LMArena Chinese14271448
LMArena French14311460
LMArena German14131431
LMArena Japanese13781387
LMArena Korean13801373
LMArena Russian14221416
LMArena Spanish14481417

Instruction Following Too close to call

Claude Opus 4.1: 75.6 (#58), Grok 3: 75.0 (#73)

BenchmarkClaude Opus 4.1Grok 3
LMArena Instruction Following14351409
IFEval—88.4%

Long Context Claude Opus 4.1 leads

Claude Opus 4.1: 44.5 (#63), Grok 3: 38.7 (#192)

BenchmarkClaude Opus 4.1Grok 3
LMArena Longer Query14551439
Fiction.LiveBench—58.3%

Writing & Preference Claude Opus 4.1 leads

Claude Opus 4.1: 62.4 (#74), Grok 3: 55.8 (#141)

BenchmarkClaude Opus 4.1Grok 3
LMArena Text14191426
LMArena Creative Writing14121414
Short-Story Creative Writing84.7%76.4%
LMArena Multi-Turn14441425
EQ-Bench Creative Writing—1186
WildBench—84.9%

Frequently asked questions

Is Claude Opus 4.1 better than Grok 3?

Claude Opus 4.1 is the stronger model overall, scoring 41.0 to 39.9 on the Noometry Index.

Is Claude Opus 4.1 or Grok 3 better for coding?

Claude Opus 4.1 scores higher on coding benchmarks: 44.4 versus 41.9 in the Noometry coding category.

How many benchmarks do Claude Opus 4.1 and Grok 3 share?

27 benchmarks have published results for both models. Claude Opus 4.1 has 48 scored results on Noometry and Grok 3 has 40.

Related comparisons

Go deeper