Model comparison

Claude Sonnet 5.5 vs Gemma 3n E4b IT

Claude Sonnet 5.5 is the stronger model overall, scoring 61.9 to 37.3 on the Noometry Index.

Last verified . 12 shared benchmarks.

Claude Sonnet 5.5 Anthropic

61.9

Rank #10 Confirmed

Gemma 3n E4b IT Google

37.3

Rank #206 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Claude Sonnet 5.5 scores higher in 8 categories and Gemma 3n E4b IT in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Sonnet 5.5 leads 87.9 to 35.1.
  • Gemma 3n E4b IT has downloadable open weights; the other is API-only.

Side by side

Claude Sonnet 5.5 and Gemma 3n E4b IT specifications
Claude Sonnet 5.5Gemma 3n E4b IT
ProviderAnthropicGoogle
Noometry Index61.937.3
Released2026-09-28—
WeightsProprietaryOpen
Context window1M—
Max output128K—
Input $ / M tokens$2—
Output $ / M tokens$10—
Results tracked3218

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 67.3 (#6), Gemma 3n E4b IT: 37.0 (#198)

Coding benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
LMArena Coding15131268
FrontierCode52.1%—
CursorBench55.5%—
LMArena WebDev1774—
FrontierSWE61.9%—
SciCode61%—
ALE-Bench1,819—

Agentic & Tool Use Not comparable

Claude Sonnet 5.5: 45.0 (#16), Gemma 3n E4b IT: —

Agentic & Tool Use benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
APEX-Agents75.5%—

Reasoning Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 54.0 (#28), Gemma 3n E4b IT: 19.9 (#247)

Reasoning benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
LMArena Hard Prompts14951284
Kagi LLM Benchmark—31.5%
NYT Connections (extended)80.5%—
CritPt31.4%—
Mystery Game Puzzles65%—
Epoch Capabilities Index165.03—

Math Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 87.9 (#6), Gemma 3n E4b IT: 35.1 (#188)

Math benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
LMArena Math15101251
FrontierMath (Tiers 1-3)88.8%—
FrontierMath Tier 480.5%—
OTIS Mock AIME 2024-2025100%—
ProofBench100%—
FrontierMath Erdős2.9%—

Knowledge Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 66.0 (#12), Gemma 3n E4b IT: 34.2 (#198)

Knowledge benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
LMArena Expert15401246
GPQA Diamond95.6%—
SimpleQA Verified46.5%—

Multimodal Not comparable

Claude Sonnet 5.5: 51.5 (#6), Gemma 3n E4b IT: —

Multimodal benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
LMArena Vision1289—
Furniture Assembly75%—

Multilingual Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 55.3 (#30), Gemma 3n E4b IT: 43.4 (#183)

Multilingual benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
LMArena Non-English14521285
LMArena Chinese15221309
LMArena Russian14511288
LMArena French—1330
LMArena German—1311
LMArena Japanese—1272
LMArena Korean—1259
LMArena Spanish—1305

Instruction Following Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 78.3 (#11), Gemma 3n E4b IT: 66.1 (#210)

Instruction Following benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
LMArena Instruction Following14951255

Long Context Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 45.9 (#28), Gemma 3n E4b IT: 38.7 (#191)

Long Context benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
LMArena Longer Query14981276

Writing & Preference Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 66.0 (#40), Gemma 3n E4b IT: 50.1 (#186)

Writing & Preference benchmarks
BenchmarkClaude Sonnet 5.5Gemma 3n E4b IT
LMArena Text14711306
LMArena Creative Writing14651287
LMArena Multi-Turn14741276

Frequently asked questions

Is Claude Sonnet 5.5 better than Gemma 3n E4b IT?

Claude Sonnet 5.5 is the stronger model overall, scoring 61.9 to 37.3 on the Noometry Index.

Is Claude Sonnet 5.5 or Gemma 3n E4b IT better for coding?

Claude Sonnet 5.5 scores higher on coding benchmarks: 67.3 versus 37.0 in the Noometry coding category.

How many benchmarks do Claude Sonnet 5.5 and Gemma 3n E4b IT share?

12 benchmarks have published results for both models. Claude Sonnet 5.5 has 32 scored results on Noometry and Gemma 3n E4b IT has 18.

Related comparisons

Go deeper