Model comparison

Claude 3.5 Sonnet vs Gemini 4 Argon

Gemini 4 Argon is the stronger model overall, scoring 56.5 to 34.6 on the Noometry Index.

Last verified . 13 shared benchmarks.

Claude 3.5 Sonnet Anthropic

34.6

Rank #231 Confirmed

Gemini 4 Argon Google

56.5

Rank #24 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Claude 3.5 Sonnet scores higher in 0 categories and Gemini 4 Argon in 10 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemini 4 Argon leads 73.9 to 19.2.

Side by side

Claude 3.5 Sonnet and Gemini 4 Argon specifications
Claude 3.5 SonnetGemini 4 Argon
ProviderAnthropicGoogle
Noometry Index34.656.5
Released2024-06-202026-09-30
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked6021

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 4 Argon leads

Claude 3.5 Sonnet: 39.0 (#165), Gemini 4 Argon: 62.0 (#9)

Coding benchmarks
BenchmarkClaude 3.5 SonnetGemini 4 Argon
LMArena Coding13421550
Aider Polyglot51.6%—
LMArena WebDev—1678
FrontierSWE—55%
SciCode—61.8%
GSO4.6%—
WeirdML40%—
BigCodeBench Instruct46.8%—
LiveBench Coding67.1%—
BigCodeBench Complete58.6%—
CadEval48%—
HumanEval+81.7%—
MBPP+74.3%—

Agentic & Tool Use Gemini 4 Argon leads

Claude 3.5 Sonnet: 32.3 (#67), Gemini 4 Argon: 49.2 (#8)

Agentic & Tool Use benchmarks
BenchmarkClaude 3.5 SonnetGemini 4 Argon
APEX-Agents—82.2%
TheAgentCompany24%—
Cybench17.5%—
BALROG32.6%—
METR Time Horizons45.2%—
Vending-Bench 2—13,718

Reasoning Gemini 4 Argon leads

Claude 3.5 Sonnet: 23.1 (#183), Gemini 4 Argon: 44.2 (#47)

Reasoning benchmarks
BenchmarkClaude 3.5 SonnetGemini 4 Argon
LMArena Hard Prompts13051548
SimpleBench41.4%—
CritPt—27.1%
EnigmaEval0.9%—
LiveBench Reasoning56.7%—
DTBench67.8%—
LiveBench Data Analysis55%—
Epoch Capabilities Index133.55—
ForecastBench60.7—
LiveBench59%—

Math Gemini 4 Argon leads

Claude 3.5 Sonnet: 19.2 (#288), Gemini 4 Argon: 73.9 (#17)

Math benchmarks
BenchmarkClaude 3.5 SonnetGemini 4 Argon
LMArena Math13071536
OTIS Mock AIME 2024-20258.5%—
ProofBench—99%
Omni-MATH27.6%—
LiveBench Math52.3%—
MATH Level 556.9%—
FrontierMath (Feb 2025 set)2.1%—
FrontierMath Tier 4 (v1)0%—

Knowledge Gemini 4 Argon leads

Claude 3.5 Sonnet: 28.6 (#245), Gemini 4 Argon: 43.9 (#89)

Knowledge benchmarks
BenchmarkClaude 3.5 SonnetGemini 4 Argon
LMArena Expert12651553
GPQA Diamond55.3%—
Humanity's Last Exam4.1%—
MMLU-Pro77.7%—
Confabulations19.9%—
GPQA (HELM)56.5%—
MMLU87.3%—

Multimodal Gemini 4 Argon leads

Claude 3.5 Sonnet: 26.5 (#120), Gemini 4 Argon: 46.5 (#14)

Multimodal benchmarks
BenchmarkClaude 3.5 SonnetGemini 4 Argon
LMArena Vision1125—
Video-MME60%—
GeoBench62%—
VPCT33%—
Blueprint-Bench 2—54.4%

Multilingual Gemini 4 Argon leads

Claude 3.5 Sonnet: 43.2 (#185), Gemini 4 Argon: 60.3 (#1)

Multilingual benchmarks
BenchmarkClaude 3.5 SonnetGemini 4 Argon
LMArena Non-English12831523
LMArena Chinese12721610
LMArena Russian13061537
LMArena Spanish12901497
LMArena French1305—
LMArena German1297—
LMArena Japanese1234—
LMArena Korean1200—

Instruction Following Gemini 4 Argon leads

Claude 3.5 Sonnet: 68.8 (#182), Gemini 4 Argon: 80.1 (#2)

Instruction Following benchmarks
BenchmarkClaude 3.5 SonnetGemini 4 Argon
LMArena Instruction Following12971538
LiveBench Instruction Following69.3%—
IFEval85.5%—

Long Context Gemini 4 Argon leads

Claude 3.5 Sonnet: 39.9 (#167), Gemini 4 Argon: 47.6 (#15)

Long Context benchmarks
BenchmarkClaude 3.5 SonnetGemini 4 Argon
LMArena Longer Query13111549

Writing & Preference Gemini 4 Argon leads

Claude 3.5 Sonnet: 52.9 (#164), Gemini 4 Argon: 71.4 (#19)

Writing & Preference benchmarks
BenchmarkClaude 3.5 SonnetGemini 4 Argon
LMArena Text12981534
LMArena Creative Writing12921531
LMArena Multi-Turn13261557
Short-Story Creative Writing80.3%—
EQ-Bench Creative Writing1451—
WildBench79.2%—
LiveBench Language53.8%—

Frequently asked questions

Is Claude 3.5 Sonnet better than Gemini 4 Argon?

Gemini 4 Argon is the stronger model overall, scoring 56.5 to 34.6 on the Noometry Index.

Is Claude 3.5 Sonnet or Gemini 4 Argon better for coding?

Gemini 4 Argon scores higher on coding benchmarks: 62.0 versus 39.0 in the Noometry coding category.

How many benchmarks do Claude 3.5 Sonnet and Gemini 4 Argon share?

13 benchmarks have published results for both models. Claude 3.5 Sonnet has 60 scored results on Noometry and Gemini 4 Argon has 21.

Related comparisons

Go deeper