Noometry

Model comparison

Claude Sonnet 5.5 vs Gemma 1.1 7b IT

Claude Sonnet 5.5 is the stronger model overall, scoring 61.9 to 31.3 on the Noometry Index.

Last verified . 12 shared benchmarks.

Claude Sonnet 5.5 Anthropic

61.9

Rank #10 Confirmed

Gemma 1.1 7b IT Google

31.3

Rank #277 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Claude Sonnet 5.5 scores higher in 8 categories and Gemma 1.1 7b IT in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Sonnet 5.5 leads 87.9 to 32.0.
  • Gemma 1.1 7b IT has downloadable open weights; the other is API-only.

Side by side

Claude Sonnet 5.5Gemma 1.1 7b IT
ProviderAnthropicGoogle
Noometry Index61.931.3
Released2026-09-28—
WeightsProprietaryOpen
Context window1M—
Max output128K—
Input $ / M tokens$2—
Output $ / M tokens$10—
Results tracked3219

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 67.3 (#6), Gemma 1.1 7b IT: 31.5 (#284)

BenchmarkClaude Sonnet 5.5Gemma 1.1 7b IT
LMArena Coding15131084
FrontierCode52.1%—
CursorBench55.5%—
LMArena WebDev1774—
FrontierSWE61.9%—
SciCode61%—
ALE-Bench1,819—
HumanEval+—35.4%
MBPP+—45%

Agentic & Tool Use Not comparable

Claude Sonnet 5.5: 45.0 (#16), Gemma 1.1 7b IT: —

BenchmarkClaude Sonnet 5.5Gemma 1.1 7b IT
APEX-Agents75.5%—

Reasoning Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 54.0 (#28), Gemma 1.1 7b IT: 20.5 (#238)

BenchmarkClaude Sonnet 5.5Gemma 1.1 7b IT
LMArena Hard Prompts14951071
NYT Connections (extended)80.5%—
CritPt31.4%—
Mystery Game Puzzles65%—
Epoch Capabilities Index165.03—

Math Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 87.9 (#6), Gemma 1.1 7b IT: 32.0 (#220)

BenchmarkClaude Sonnet 5.5Gemma 1.1 7b IT
LMArena Math15101107
FrontierMath (Tiers 1-3)88.8%—
FrontierMath Tier 480.5%—
OTIS Mock AIME 2024-2025100%—
ProofBench100%—
FrontierMath Erdős2.9%—

Knowledge Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 66.0 (#12), Gemma 1.1 7b IT: 28.3 (#247)

BenchmarkClaude Sonnet 5.5Gemma 1.1 7b IT
LMArena Expert15401039
GPQA Diamond95.6%—
SimpleQA Verified46.5%—

Multimodal Not comparable

Claude Sonnet 5.5: 51.5 (#6), Gemma 1.1 7b IT: —

BenchmarkClaude Sonnet 5.5Gemma 1.1 7b IT
LMArena Vision1289—
Furniture Assembly75%—

Multilingual Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 55.3 (#30), Gemma 1.1 7b IT: 28.1 (#273)

BenchmarkClaude Sonnet 5.5Gemma 1.1 7b IT
LMArena Non-English14521052
LMArena Chinese15221061
LMArena Russian14511046
LMArena French—1065
LMArena German—1054
LMArena Japanese—971
LMArena Korean—988
LMArena Spanish—1049

Instruction Following Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 78.3 (#11), Gemma 1.1 7b IT: 54.0 (#283)

BenchmarkClaude Sonnet 5.5Gemma 1.1 7b IT
LMArena Instruction Following14951057

Long Context Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 45.9 (#28), Gemma 1.1 7b IT: 32.1 (#272)

BenchmarkClaude Sonnet 5.5Gemma 1.1 7b IT
LMArena Longer Query14981056

Writing & Preference Claude Sonnet 5.5 leads

Claude Sonnet 5.5: 66.0 (#40), Gemma 1.1 7b IT: 30.4 (#288)

BenchmarkClaude Sonnet 5.5Gemma 1.1 7b IT
LMArena Text14711094
LMArena Creative Writing14651060
LMArena Multi-Turn14741040

Frequently asked questions

Is Claude Sonnet 5.5 better than Gemma 1.1 7b IT?

Claude Sonnet 5.5 is the stronger model overall, scoring 61.9 to 31.3 on the Noometry Index.

Is Claude Sonnet 5.5 or Gemma 1.1 7b IT better for coding?

Claude Sonnet 5.5 scores higher on coding benchmarks: 67.3 versus 31.5 in the Noometry coding category.

How many benchmarks do Claude Sonnet 5.5 and Gemma 1.1 7b IT share?

12 benchmarks have published results for both models. Claude Sonnet 5.5 has 32 scored results on Noometry and Gemma 1.1 7b IT has 19.

Related comparisons

Go deeper