Model comparison

Gemma 3 1B vs Gemma 7B

Gemma 7B is the stronger model overall, scoring 30.0 to 21.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 3 1B Google

21.1

Rank #353 Reported

Gemma 7B Google

30.0

Rank #299 Confirmed

Summary

  • The widest gap is in math, where Gemma 7B leads 31.2 to 10.2.

Side by side

Gemma 3 1B and Gemma 7B specifications
Gemma 3 1BGemma 7B
ProviderGoogleGoogle
Noometry Index21.130.0
Released2025-03-122024-02-21
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked427

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Gemma 7B: 30.5 (#294)

Coding benchmarks
BenchmarkGemma 3 1BGemma 7B
LMArena Coding—1048
HumanEval+—28.7%
MBPP+—43.4%

Agentic & Tool Use Not comparable

Gemma 3 1B: 13.7 (#152), Gemma 7B: —

Agentic & Tool Use benchmarks
BenchmarkGemma 3 1BGemma 7B
Berkeley Function Calling Leaderboard7.2%—

Reasoning Too close to call

Gemma 3 1B: 19.2 (#264), Gemma 7B: 19.9 (#249)

Reasoning benchmarks
BenchmarkGemma 3 1BGemma 7B
Chess Puzzles0%—
LMArena Hard Prompts—1042
Adversarial NLI—48.7%
BIG-Bench Hard—55.1%
Epoch Capabilities Index—111.99
HellaSwag—82.2%
PIQA—81.2%
WinoGrande—79%

Math Gemma 7B leads

Gemma 3 1B: 10.2 (#316), Gemma 7B: 31.2 (#228)

Math benchmarks
BenchmarkGemma 3 1BGemma 7B
OTIS Mock AIME 2024-20251.1%—
LMArena Math—1066
GSM8K—46.4%

Knowledge Gemma 7B leads

Gemma 3 1B: 7.0 (#314), Gemma 7B: 27.3 (#252)

Knowledge benchmarks
BenchmarkGemma 3 1BGemma 7B
GPQA Diamond19.9%—
LMArena Expert—1001
ARC (AI2) Challenge—78.3%
BoolQ—83.2%
MMLU—66.1%
OpenBookQA—78.6%
TriviaQA—72.3%

Multilingual Not comparable

Gemma 3 1B: —, Gemma 7B: 25.1 (#287)

Multilingual benchmarks
BenchmarkGemma 3 1BGemma 7B
LMArena Non-English—999
LMArena Chinese—1035
LMArena French—1025
LMArena Russian—993

Instruction Following Not comparable

Gemma 3 1B: —, Gemma 7B: 51.5 (#295)

Instruction Following benchmarks
BenchmarkGemma 3 1BGemma 7B
LMArena Instruction Following—1017

Long Context Not comparable

Gemma 3 1B: —, Gemma 7B: 31.1 (#282)

Long Context benchmarks
BenchmarkGemma 3 1BGemma 7B
LMArena Longer Query—1022

Writing & Preference Not comparable

Gemma 3 1B: —, Gemma 7B: 27.1 (#302)

Writing & Preference benchmarks
BenchmarkGemma 3 1BGemma 7B
LMArena Text—1056
LMArena Creative Writing—1024
LMArena Multi-Turn—963

Frequently asked questions

Is Gemma 3 1B better than Gemma 7B?

Gemma 7B is the stronger model overall, scoring 30.0 to 21.1 on the Noometry Index.

How many benchmarks do Gemma 3 1B and Gemma 7B share?

0 benchmarks have published results for both models. Gemma 3 1B has 4 scored results on Noometry and Gemma 7B has 27.

Related comparisons

Go deeper