Model comparison

Gemma 1.1 2b IT vs Gemma 3 1B

Gemma 1.1 2b IT is the stronger model overall, scoring 29.3 to 21.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 1.1 2b IT Google

29.3

Rank #313 Confirmed

Gemma 3 1B Google

21.1

Rank #353 Reported

Summary

  • The widest gap is in math, where Gemma 1.1 2b IT leads 30.8 to 10.2.

Side by side

Gemma 1.1 2b IT and Gemma 3 1B specifications
Gemma 1.1 2b ITGemma 3 1B
ProviderGoogleGoogle
Noometry Index29.321.1
Released—2025-03-12
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked164

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 1.1 2b IT: 30.1 (#299), Gemma 3 1B: —

Coding benchmarks
BenchmarkGemma 1.1 2b ITGemma 3 1B
LMArena Coding1034—
HumanEval+17.7%—
MBPP+23.3%—

Agentic & Tool Use Not comparable

Gemma 1.1 2b IT: —, Gemma 3 1B: 13.7 (#152)

Agentic & Tool Use benchmarks
BenchmarkGemma 1.1 2b ITGemma 3 1B
Berkeley Function Calling Leaderboard—7.2%

Reasoning Too close to call

Gemma 1.1 2b IT: 19.1 (#270), Gemma 3 1B: 19.2 (#264)

Reasoning benchmarks
BenchmarkGemma 1.1 2b ITGemma 3 1B
Chess Puzzles—0%
LMArena Hard Prompts1005—

Math Gemma 1.1 2b IT leads

Gemma 1.1 2b IT: 30.8 (#232), Gemma 3 1B: 10.2 (#316)

Math benchmarks
BenchmarkGemma 1.1 2b ITGemma 3 1B
OTIS Mock AIME 2024-2025—1.1%
LMArena Math1047—

Knowledge Gemma 1.1 2b IT leads

Gemma 1.1 2b IT: 26.5 (#258), Gemma 3 1B: 7.0 (#314)

Knowledge benchmarks
BenchmarkGemma 1.1 2b ITGemma 3 1B
GPQA Diamond—19.9%
LMArena Expert970—

Multilingual Not comparable

Gemma 1.1 2b IT: 24.6 (#289), Gemma 3 1B: —

Multilingual benchmarks
BenchmarkGemma 1.1 2b ITGemma 3 1B
LMArena Non-English988—
LMArena Chinese1012—
LMArena German944—
LMArena Korean899—
LMArena Russian990—

Instruction Following Not comparable

Gemma 1.1 2b IT: 49.9 (#299), Gemma 3 1B: —

Instruction Following benchmarks
BenchmarkGemma 1.1 2b ITGemma 3 1B
LMArena Instruction Following992—

Long Context Not comparable

Gemma 1.1 2b IT: 30.6 (#286), Gemma 3 1B: —

Long Context benchmarks
BenchmarkGemma 1.1 2b ITGemma 3 1B
LMArena Longer Query1003—

Writing & Preference Not comparable

Gemma 1.1 2b IT: 25.1 (#306), Gemma 3 1B: —

Writing & Preference benchmarks
BenchmarkGemma 1.1 2b ITGemma 3 1B
LMArena Text1022—
LMArena Creative Writing998—
LMArena Multi-Turn959—

Frequently asked questions

Is Gemma 1.1 2b IT better than Gemma 3 1B?

Gemma 1.1 2b IT is the stronger model overall, scoring 29.3 to 21.1 on the Noometry Index.

How many benchmarks do Gemma 1.1 2b IT and Gemma 3 1B share?

0 benchmarks have published results for both models. Gemma 1.1 2b IT has 16 scored results on Noometry and Gemma 3 1B has 4.

Related comparisons

Go deeper