Model comparison

Gemma 2 2b IT vs Gemma 3 1B

Gemma 2 2b IT is the stronger model overall, scoring 32.5 to 20.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 2 2b IT Google

32.5

Rank #244 Confirmed

Gemma 3 1B Google

20.7

Rank #348 Reported

Summary

  • The widest gap is in knowledge, where Gemma 2 2b IT leads 29.3 to 7.1.

Side by side

Gemma 2 2b IT and Gemma 3 1B specifications
Gemma 2 2b ITGemma 3 1B
ProviderGoogleGoogle
Noometry Index32.520.7
Released—2025-03-12
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked174

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 2 2b IT: 31.8 (#268), Gemma 3 1B: —

Coding benchmarks
BenchmarkGemma 2 2b ITGemma 3 1B
LMArena Coding1112—

Agentic & Tool Use Not comparable

Gemma 2 2b IT: —, Gemma 3 1B: 13.5 (#144)

Agentic & Tool Use benchmarks
BenchmarkGemma 2 2b ITGemma 3 1B
Berkeley Function Calling Leaderboard—7.2%

Reasoning Gemma 2 2b IT leads

Gemma 2 2b IT: 20.5 (#219), Gemma 3 1B: 18.5 (#260)

Reasoning benchmarks
BenchmarkGemma 2 2b ITGemma 3 1B
Chess Puzzles—0%
LMArena Hard Prompts1113—

Math Gemma 2 2b IT leads

Gemma 2 2b IT: 30.1 (#212), Gemma 3 1B: 9.6 (#310)

Math benchmarks
BenchmarkGemma 2 2b ITGemma 3 1B
OTIS Mock AIME 2024-2025—1.1%
LMArena Math1135—

Knowledge Gemma 2 2b IT leads

Gemma 2 2b IT: 29.3 (#229), Gemma 3 1B: 7.1 (#309)

Knowledge benchmarks
BenchmarkGemma 2 2b ITGemma 3 1B
GPQA Diamond—19.9%
LMArena Expert1096—

Multilingual Not comparable

Gemma 2 2b IT: 32.5 (#252), Gemma 3 1B: —

Multilingual benchmarks
BenchmarkGemma 2 2b ITGemma 3 1B
LMArena Non-English1121—
LMArena Chinese1132—
LMArena French1156—
LMArena German1114—
LMArena Japanese1083—
LMArena Korean1055—
LMArena Russian1118—
LMArena Spanish1140—

Instruction Following Not comparable

Gemma 2 2b IT: 58.1 (#258), Gemma 3 1B: —

Instruction Following benchmarks
BenchmarkGemma 2 2b ITGemma 3 1B
LMArena Instruction Following1118—

Long Context Not comparable

Gemma 2 2b IT: 34.2 (#245), Gemma 3 1B: —

Long Context benchmarks
BenchmarkGemma 2 2b ITGemma 3 1B
LMArena Longer Query1130—

Writing & Preference Not comparable

Gemma 2 2b IT: 36.6 (#258), Gemma 3 1B: —

Writing & Preference benchmarks
BenchmarkGemma 2 2b ITGemma 3 1B
LMArena Text1156—
LMArena Creative Writing1147—
LMArena Multi-Turn1118—

Frequently asked questions

Is Gemma 2 2b IT better than Gemma 3 1B?

Gemma 2 2b IT is the stronger model overall, scoring 32.5 to 20.7 on the Noometry Index.

How many benchmarks do Gemma 2 2b IT and Gemma 3 1B share?

0 benchmarks have published results for both models. Gemma 2 2b IT has 17 scored results on Noometry and Gemma 3 1B has 4.

Related comparisons

Go deeper