Noometry

Model comparison

Claude Sonnet 4.6 vs Gemma 3 1B

Claude Sonnet 4.6 is the stronger model overall, scoring 50.1 to 20.7 on the Noometry Index.

Last verified . 3 shared benchmarks.

Claude Sonnet 4.6 Anthropic

50.1

Rank #42 Confirmed

Gemma 3 1B Google

20.7

Rank #348 Reported

Summary

  • They share 3 benchmarks with published results for both. Claude Sonnet 4.6 scores higher in 4 categories and Gemma 3 1B in 0 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Claude Sonnet 4.6 leads 51.6 to 7.1.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 85.8% for Claude Sonnet 4.6 and 1.1% for Gemma 3 1B.
  • Gemma 3 1B has downloadable open weights; the other is API-only.

Side by side

Claude Sonnet 4.6Gemma 3 1B
ProviderAnthropicGoogle
Noometry Index50.120.7
Released2026-02-172025-03-12
WeightsProprietaryOpen
Context window1M—
Max output128K—
Input $ / M tokens$3—
Output $ / M tokens$15—
Results tracked574

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude Sonnet 4.6: 46.0 (#62), Gemma 3 1B: —

BenchmarkClaude Sonnet 4.6Gemma 3 1B
SWE-bench Verified75.2%—
DeepSWE29.9%—
FrontierCode24.3%—
LMArena WebDev1521—
SciCode46.8%—
WeirdML66.1%—
LMArena Coding1504—
ALE-Bench1,327—

Agentic & Tool Use Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 39.1 (#26), Gemma 3 1B: 13.5 (#144)

BenchmarkClaude Sonnet 4.6Gemma 3 1B
Terminal-Bench53.4%—
APEX-Agents43%—
Berkeley Function Calling Leaderboard—7.2%
OSWorld 2.09.3%—
DeepResearch Bench54.9%—
OSWorld72.1%—
ExploitBench23.6%—
GBAEval48.8%—
GDP.pdf18%—
LMArena Search1221—
Vending-Bench 27,204—

Reasoning Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 46.1 (#40), Gemma 3 1B: 18.5 (#260)

BenchmarkClaude Sonnet 4.6Gemma 3 1B
Chess Puzzles13%0%
ARC-AGI-260.4%—
NYT Connections (extended)80.9%—
ARC-AGI-186.5%—
CritPt3.1%—
Thematic Generalization76.3%—
LMArena Hard Prompts1485—
Mystery Game Puzzles16%—
DTBench89.9%—
LMCA46.5%—
Epoch Capabilities Index152.25—
ForecastBench62—

Math Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 51.9 (#41), Gemma 3 1B: 9.6 (#310)

BenchmarkClaude Sonnet 4.6Gemma 3 1B
OTIS Mock AIME 2024-202585.8%1.1%
ProofBench45%—
LMArena Math1463—
FrontierMath (Feb 2025 set)32.4%—
FrontierMath Tier 4 (v1)8.3%—

Knowledge Claude Sonnet 4.6 leads

Claude Sonnet 4.6: 51.6 (#60), Gemma 3 1B: 7.1 (#309)

BenchmarkClaude Sonnet 4.6Gemma 3 1B
GPQA Diamond87.4%19.9%
SimpleQA Verified35.5%—
Vectara Hallucination Rate10.6%—
LMArena Expert1500—

Multimodal Not comparable

Claude Sonnet 4.6: 38.0 (#61), Gemma 3 1B: —

BenchmarkClaude Sonnet 4.6Gemma 3 1B
LMArena Vision1283—
Blueprint-Bench 26.7%—
LMArena Document1482—

Multilingual Not comparable

Claude Sonnet 4.6: 54.6 (#39), Gemma 3 1B: —

BenchmarkClaude Sonnet 4.6Gemma 3 1B
LMArena Non-English1440—
LMArena Chinese1491—
LMArena French1465—
LMArena German1428—
LMArena Japanese1419—
LMArena Korean1411—
LMArena Russian1440—
LMArena Spanish1465—

Instruction Following Not comparable

Claude Sonnet 4.6: 77.6 (#23), Gemma 3 1B: —

BenchmarkClaude Sonnet 4.6Gemma 3 1B
LMArena Instruction Following1476—

Long Context Not comparable

Claude Sonnet 4.6: 45.3 (#40), Gemma 3 1B: —

BenchmarkClaude Sonnet 4.6Gemma 3 1B
LMArena Longer Query1479—

Writing & Preference Not comparable

Claude Sonnet 4.6: 70.4 (#22), Gemma 3 1B: —

BenchmarkClaude Sonnet 4.6Gemma 3 1B
LMArena Text1458—
LMArena Creative Writing1435—
EQ-Bench Creative Writing1810—
EQ-Bench 41207—
LMArena Multi-Turn1464—

Frequently asked questions

Is Claude Sonnet 4.6 better than Gemma 3 1B?

Claude Sonnet 4.6 is the stronger model overall, scoring 50.1 to 20.7 on the Noometry Index.

How many benchmarks do Claude Sonnet 4.6 and Gemma 3 1B share?

3 benchmarks have published results for both models. Claude Sonnet 4.6 has 57 scored results on Noometry and Gemma 3 1B has 4.

Related comparisons

Go deeper