Model comparison

Gemma 1.1 7b IT vs Gemma 3 1B

Gemma 1.1 7b IT is the stronger model overall, scoring 30.7 to 20.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 1.1 7b IT Google

30.7

Rank #275 Confirmed

Gemma 3 1B Google

20.7

Rank #348 Reported

Summary

  • The widest gap is in knowledge, where Gemma 1.1 7b IT leads 27.8 to 7.1.

Side by side

Gemma 1.1 7b IT and Gemma 3 1B specifications
Gemma 1.1 7b ITGemma 3 1B
ProviderGoogleGoogle
Noometry Index30.720.7
Released—2025-03-12
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked194

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 1.1 7b IT: 31.0 (#279), Gemma 3 1B: —

Coding benchmarks
BenchmarkGemma 1.1 7b ITGemma 3 1B
LMArena Coding1084—
HumanEval+35.4%—
MBPP+45%—

Agentic & Tool Use Not comparable

Gemma 1.1 7b IT: —, Gemma 3 1B: 13.5 (#144)

Agentic & Tool Use benchmarks
BenchmarkGemma 1.1 7b ITGemma 3 1B
Berkeley Function Calling Leaderboard—7.2%

Reasoning Gemma 1.1 7b IT leads

Gemma 1.1 7b IT: 19.6 (#235), Gemma 3 1B: 18.5 (#260)

Reasoning benchmarks
BenchmarkGemma 1.1 7b ITGemma 3 1B
Chess Puzzles—0%
LMArena Hard Prompts1071—

Math Gemma 1.1 7b IT leads

Gemma 1.1 7b IT: 29.5 (#217), Gemma 3 1B: 9.6 (#310)

Math benchmarks
BenchmarkGemma 1.1 7b ITGemma 3 1B
OTIS Mock AIME 2024-2025—1.1%
LMArena Math1107—

Knowledge Gemma 1.1 7b IT leads

Gemma 1.1 7b IT: 27.8 (#242), Gemma 3 1B: 7.1 (#309)

Knowledge benchmarks
BenchmarkGemma 1.1 7b ITGemma 3 1B
GPQA Diamond—19.9%
LMArena Expert1039—

Multilingual Not comparable

Gemma 1.1 7b IT: 28.3 (#268), Gemma 3 1B: —

Multilingual benchmarks
BenchmarkGemma 1.1 7b ITGemma 3 1B
LMArena Non-English1052—
LMArena Chinese1060—
LMArena French1064—
LMArena German1054—
LMArena Japanese971—
LMArena Korean988—
LMArena Russian1046—
LMArena Spanish1049—

Instruction Following Not comparable

Gemma 1.1 7b IT: 54.3 (#278), Gemma 3 1B: —

Instruction Following benchmarks
BenchmarkGemma 1.1 7b ITGemma 3 1B
LMArena Instruction Following1057—

Long Context Not comparable

Gemma 1.1 7b IT: 32.0 (#267), Gemma 3 1B: —

Long Context benchmarks
BenchmarkGemma 1.1 7b ITGemma 3 1B
LMArena Longer Query1056—

Writing & Preference Not comparable

Gemma 1.1 7b IT: 30.6 (#283), Gemma 3 1B: —

Writing & Preference benchmarks
BenchmarkGemma 1.1 7b ITGemma 3 1B
LMArena Text1094—
LMArena Creative Writing1059—
LMArena Multi-Turn1040—

Frequently asked questions

Is Gemma 1.1 7b IT better than Gemma 3 1B?

Gemma 1.1 7b IT is the stronger model overall, scoring 30.7 to 20.7 on the Noometry Index.

How many benchmarks do Gemma 1.1 7b IT and Gemma 3 1B share?

0 benchmarks have published results for both models. Gemma 1.1 7b IT has 19 scored results on Noometry and Gemma 3 1B has 4.

Related comparisons

Go deeper