Noometry

Model comparison

Claude Opus 4 vs Gemini 3.1 Pro Preview

Gemini 3.1 Pro Preview is the stronger model overall, scoring 56.7 to 43.1 on the Noometry Index.

Last verified . 41 shared benchmarks.

Claude Opus 4 Anthropic

43.1

Rank #100 Confirmed

Gemini 3.1 Pro Preview Google

56.7

Rank #23 Confirmed

Summary

  • They share 41 benchmarks with published results for both. Claude Opus 4 scores higher in 2 categories and Gemini 3.1 Pro Preview in 8 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3.1 Pro Preview leads 71.7 to 27.3.
  • The biggest single-benchmark swing is ARC-AGI-2: 8.6% for Claude Opus 4 and 77.1% for Gemini 3.1 Pro Preview.
  • Gemini 3.1 Pro Preview is cheaper at $2 / $12 per million input/output tokens, against $15 / $75 for Claude Opus 4.
  • Gemini 3.1 Pro Preview accepts more context: 1.05M tokens versus 200K.

Side by side

Claude Opus 4Gemini 3.1 Pro Preview
ProviderAnthropicGoogle
Noometry Index43.156.7
Released2025-05-222026-02-19
WeightsProprietaryProprietary
Context window200K1.05M
Max output32K66K
Input $ / M tokens$15$2
Output $ / M tokens$75$12
Results tracked5671

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Opus 4 leads

Claude Opus 4: 47.2 (#62), Gemini 3.1 Pro Preview: 42.5 (#99)

BenchmarkClaude Opus 4Gemini 3.1 Pro Preview
SWE-bench Verified70.7%75.6%
GSO6.9%22.6%
WeirdML43.7%72.1%
LMArena Coding14421484
AlgoTune1.332.02
DeepSWE—11.7%
SWE-bench Verified (bash only)67.6%—
Aider Polyglot72%—
LMArena WebDev—1447
SciCode—58.9%
MirrorCode—8.9%
ALE-Bench—1,161

Agentic & Tool Use Gemini 3.1 Pro Preview leads

Claude Opus 4: 34.8 (#42), Gemini 3.1 Pro Preview: 37.7 (#34)

BenchmarkClaude Opus 4Gemini 3.1 Pro Preview
DeepResearch Bench46.8%47.8%
LMArena Search11271211
METR Time Horizons63.9%77%
Terminal-Bench—80.2%
APEX-Agents—35.3%
τ²-bench Banking—26%
Cybench38%—
PostTrainBench—22%
BALROG—57%
ExploitBench—26.1%
GBAEval—0.8%
GDP.pdf—17%
Vending-Bench 2—3,774

Reasoning Gemini 3.1 Pro Preview leads

Claude Opus 4: 27.3 (#121), Gemini 3.1 Pro Preview: 71.7 (#12)

BenchmarkClaude Opus 4Gemini 3.1 Pro Preview
ARC-AGI-28.6%77.1%
SimpleBench58.8%79.6%
ARC-AGI-135.7%98%
CritPt0.3%17.7%
EnigmaEval5.6%36.8%
LMArena Hard Prompts13991485
DTBench81.6%97.1%
LMCA37.4%53.8%
Epoch Capabilities Index142.67154.77
ForecastBench61.159
Kagi LLM Benchmark74.3%—
NYT Connections (extended)—97.4%
Chess Puzzles—55%
Thematic Generalization—79.4%
EBR-Bench—14.3%
Mystery Game Puzzles—34%

Math Gemini 3.1 Pro Preview leads

Claude Opus 4: 42.0 (#86), Gemini 3.1 Pro Preview: 62.1 (#34)

BenchmarkClaude Opus 4Gemini 3.1 Pro Preview
OTIS Mock AIME 2024-202564.4%95.6%
LMArena Math13901485
FrontierMath (Feb 2025 set)4.5%36.9%
FrontierMath Tier 4 (v1)4.2%16.7%
FrontierMath (Tiers 1-3)—59.6%
FrontierMath Tier 4—26.8%
MathArena Final-Answer Competitions—86.5%
ProofBench—26%
Omni-MATH61.6%—
MATH Level 585%—

Knowledge Gemini 3.1 Pro Preview leads

Claude Opus 4: 44.0 (#88), Gemini 3.1 Pro Preview: 71.8 (#3)

BenchmarkClaude Opus 4Gemini 3.1 Pro Preview
GPQA Diamond76.3%94.4%
Humanity's Last Exam10.7%46.4%
Vectara Hallucination Rate12%10.4%
LMArena Expert13861485
SimpleQA Verified—73.5%
MMLU-Pro87.5%—
Confabulations15.9%—
GPQA (HELM)70.8%—

Multimodal Gemini 3.1 Pro Preview leads

Claude Opus 4: 31.5 (#106), Gemini 3.1 Pro Preview: 37.9 (#69)

BenchmarkClaude Opus 4Gemini 3.1 Pro Preview
LMArena Vision11921296
GeoBench49%—
VPCT38%—
Blueprint-Bench 2—26.5%
Furniture Assembly—26.7%
LMArena Document—1444

Multilingual Gemini 3.1 Pro Preview leads

Claude Opus 4: 48.8 (#138), Gemini 3.1 Pro Preview: 57.0 (#12)

BenchmarkClaude Opus 4Gemini 3.1 Pro Preview
LMArena Non-English13621477
LMArena Chinese13861529
LMArena French13721487
LMArena German13911491
LMArena Japanese13311493
LMArena Korean13211455
LMArena Russian13921498
LMArena Spanish13891479

Instruction Following Too close to call

Claude Opus 4: 77.1 (#28), Gemini 3.1 Pro Preview: 77.0 (#32)

BenchmarkClaude Opus 4Gemini 3.1 Pro Preview
LMArena Instruction Following14061466
IFEval91.8%—

Long Context Gemini 3.1 Pro Preview leads

Claude Opus 4: 39.6 (#172), Gemini 3.1 Pro Preview: 47.4 (#18)

BenchmarkClaude Opus 4Gemini 3.1 Pro Preview
LMArena Longer Query14221483
Fiction.LiveBench61.1%—
CL-bench—20.8%
CL-bench Life—16.9%

Writing & Preference Gemini 3.1 Pro Preview leads

Claude Opus 4: 61.2 (#89), Gemini 3.1 Pro Preview: 66.1 (#37)

BenchmarkClaude Opus 4Gemini 3.1 Pro Preview
LMArena Text13771481
LMArena Creative Writing13871482
EQ-Bench Creative Writing15801491
LMArena Multi-Turn13961488
Short-Story Creative Writing83.6%—
WildBench85.2%—
EQ-Bench 4—1142

Frequently asked questions

Is Claude Opus 4 better than Gemini 3.1 Pro Preview?

Gemini 3.1 Pro Preview is the stronger model overall, scoring 56.7 to 43.1 on the Noometry Index.

Which is cheaper, Claude Opus 4 or Gemini 3.1 Pro Preview?

Gemini 3.1 Pro Preview is cheaper. It lists at $2 per million input tokens and $12 per million output tokens; Claude Opus 4 lists at $15 and $75.

Is Claude Opus 4 or Gemini 3.1 Pro Preview better for coding?

Claude Opus 4 scores higher on coding benchmarks: 47.2 versus 42.5 in the Noometry coding category.

Which has the bigger context window?

Gemini 3.1 Pro Preview does, with 1.05M tokens against 200K.

How many benchmarks do Claude Opus 4 and Gemini 3.1 Pro Preview share?

41 benchmarks have published results for both models. Claude Opus 4 has 56 scored results on Noometry and Gemini 3.1 Pro Preview has 71.

Related comparisons

Go deeper