Model comparison

Claude Sonnet 5 vs Gemma 3n E4b IT

Claude Sonnet 5 is the stronger model overall, scoring 54.6 to 37.3 on the Noometry Index.

Last verified . 17 shared benchmarks.

Claude Sonnet 5 Anthropic

54.6

Rank #29 Confirmed

Gemma 3n E4b IT Google

37.3

Rank #206 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Claude Sonnet 5 scores higher in 8 categories and Gemma 3n E4b IT in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Sonnet 5 leads 66.2 to 35.1.
  • Gemma 3n E4b IT has downloadable open weights; the other is API-only.

Side by side

Claude Sonnet 5 and Gemma 3n E4b IT specifications
Claude Sonnet 5Gemma 3n E4b IT
ProviderAnthropicGoogle
Noometry Index54.637.3
Released2026-06-29—
WeightsProprietaryOpen
Context window1M—
Max output128K—
Input $ / M tokens$2—
Output $ / M tokens$10—
Results tracked5118

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 5 leads

Claude Sonnet 5: 55.5 (#26), Gemma 3n E4b IT: 37.0 (#198)

Coding benchmarks
BenchmarkClaude Sonnet 5Gemma 3n E4b IT
LMArena Coding14831268
DeepSWE53.8%—
FrontierCode42.7%—
CursorBench34.1%—
LMArena WebDev1541—
SciCode54.3%—
GSO37.3%—
WeirdML68.8%—
ALE-Bench1,463—

Agentic & Tool Use Not comparable

Claude Sonnet 5: 42.8 (#18), Gemma 3n E4b IT: —

Agentic & Tool Use benchmarks
BenchmarkClaude Sonnet 5Gemma 3n E4b IT
APEX-Agents54.5%—
GBAEval65.3%—
LMArena Search1194—
Vending-Bench 26,378—

Reasoning Claude Sonnet 5 leads

Claude Sonnet 5: 49.1 (#39), Gemma 3n E4b IT: 19.9 (#247)

Reasoning benchmarks
BenchmarkClaude Sonnet 5Gemma 3n E4b IT
LMArena Hard Prompts14611284
SimpleBench60.6%—
Kagi LLM Benchmark—31.5%
NYT Connections (extended)75.1%—
CritPt16.9%—
Chess Puzzles35%—
Mystery Game Puzzles35%—
DTBench92.5%—
LMCA50%—
Surface Evolver Bench60%—
Bench to the Future 30.14—
Epoch Capabilities Index156.21—
ForecastBench61.1—

Math Claude Sonnet 5 leads

Claude Sonnet 5: 66.2 (#27), Gemma 3n E4b IT: 35.1 (#188)

Math benchmarks
BenchmarkClaude Sonnet 5Gemma 3n E4b IT
LMArena Math14671251
FrontierMath (Tiers 1-3)65.6%—
FrontierMath Tier 429.3%—
OTIS Mock AIME 2024-202594.7%—
ProofBench77%—

Knowledge Claude Sonnet 5 leads

Claude Sonnet 5: 55.6 (#47), Gemma 3n E4b IT: 34.2 (#198)

Knowledge benchmarks
BenchmarkClaude Sonnet 5Gemma 3n E4b IT
LMArena Expert14901246
GPQA Diamond90.5%—
SimpleQA Verified33.7%—

Multimodal Not comparable

Claude Sonnet 5: 42.4 (#31), Gemma 3n E4b IT: —

Multimodal benchmarks
BenchmarkClaude Sonnet 5Gemma 3n E4b IT
LMArena Vision1274—
Blueprint-Bench 224.9%—
LMArena Document1466—

Multilingual Claude Sonnet 5 leads

Claude Sonnet 5: 53.8 (#55), Gemma 3n E4b IT: 43.4 (#183)

Multilingual benchmarks
BenchmarkClaude Sonnet 5Gemma 3n E4b IT
LMArena Non-English14311285
LMArena Chinese14771309
LMArena French14601330
LMArena German14401311
LMArena Japanese14221272
LMArena Korean14111259
LMArena Russian14511288
LMArena Spanish14371305

Instruction Following Claude Sonnet 5 leads

Claude Sonnet 5: 76.3 (#41), Gemma 3n E4b IT: 66.1 (#210)

Instruction Following benchmarks
BenchmarkClaude Sonnet 5Gemma 3n E4b IT
LMArena Instruction Following14521255

Long Context Claude Sonnet 5 leads

Claude Sonnet 5: 44.8 (#55), Gemma 3n E4b IT: 38.7 (#191)

Long Context benchmarks
BenchmarkClaude Sonnet 5Gemma 3n E4b IT
LMArena Longer Query14631276

Writing & Preference Claude Sonnet 5 leads

Claude Sonnet 5: 69.2 (#25), Gemma 3n E4b IT: 50.1 (#186)

Writing & Preference benchmarks
BenchmarkClaude Sonnet 5Gemma 3n E4b IT
LMArena Text14421306
LMArena Creative Writing14161287
LMArena Multi-Turn14541276
EQ-Bench Creative Writing1794—
EQ-Bench 41236—

Frequently asked questions

Is Claude Sonnet 5 better than Gemma 3n E4b IT?

Claude Sonnet 5 is the stronger model overall, scoring 54.6 to 37.3 on the Noometry Index.

Is Claude Sonnet 5 or Gemma 3n E4b IT better for coding?

Claude Sonnet 5 scores higher on coding benchmarks: 55.5 versus 37.0 in the Noometry coding category.

How many benchmarks do Claude Sonnet 5 and Gemma 3n E4b IT share?

17 benchmarks have published results for both models. Claude Sonnet 5 has 51 scored results on Noometry and Gemma 3n E4b IT has 18.

Related comparisons

Go deeper