Model comparison

Gemini 1.0 Pro vs Gemma 3 1B

Gemini 1.0 Pro is the stronger model overall, scoring 27.3 to 21.1 on the Noometry Index.

Last verified . 2 shared benchmarks.

Gemini 1.0 Pro Google

27.3

Rank #332 Confirmed

Gemma 3 1B Google

21.1

Rank #353 Reported

Summary

  • They share 2 benchmarks with published results for both. Gemini 1.0 Pro scores higher in 1 category and Gemma 3 1B in 2 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 1.0 Pro leads 15.6 to 7.0.
  • The biggest single-benchmark swing is GPQA Diamond: 34% for Gemini 1.0 Pro and 19.9% for Gemma 3 1B.
  • Gemma 3 1B has downloadable open weights; the other is API-only.

Side by side

Gemini 1.0 Pro and Gemma 3 1B specifications
Gemini 1.0 ProGemma 3 1B
ProviderGoogleGoogle
Noometry Index27.321.1
Released2023-12-132025-03-12
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked244

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemini 1.0 Pro: 32.2 (#275), Gemma 3 1B: —

Coding benchmarks
BenchmarkGemini 1.0 ProGemma 3 1B
LMArena Coding1108—
HumanEval+55.5%—
MBPP+61.4%—

Agentic & Tool Use Not comparable

Gemini 1.0 Pro: —, Gemma 3 1B: 13.7 (#152)

Agentic & Tool Use benchmarks
BenchmarkGemini 1.0 ProGemma 3 1B
Berkeley Function Calling Leaderboard—7.2%

Reasoning Gemma 3 1B leads

Gemini 1.0 Pro: 17.1 (#296), Gemma 3 1B: 19.2 (#264)

Reasoning benchmarks
BenchmarkGemini 1.0 ProGemma 3 1B
Chess Puzzles—0%
LMArena Hard Prompts1109—
DTBench45.9%—
Epoch Capabilities Index117.04—

Math Too close to call

Gemini 1.0 Pro: 9.3 (#321), Gemma 3 1B: 10.2 (#316)

Math benchmarks
BenchmarkGemini 1.0 ProGemma 3 1B
OTIS Mock AIME 2024-20251.1%1.1%
LMArena Math1132—
MATH Level 511.2%—

Knowledge Gemini 1.0 Pro leads

Gemini 1.0 Pro: 15.6 (#291), Gemma 3 1B: 7.0 (#314)

Knowledge benchmarks
BenchmarkGemini 1.0 ProGemma 3 1B
GPQA Diamond34%19.9%
LMArena Expert1059—
MMLU70%—

Multilingual Not comparable

Gemini 1.0 Pro: 33.4 (#252), Gemma 3 1B: —

Multilingual benchmarks
BenchmarkGemini 1.0 ProGemma 3 1B
LMArena Non-English1138—
LMArena Chinese1124—
LMArena French1145—
LMArena German1125—
LMArena Japanese1023—
LMArena Russian1186—
LMArena Spanish1119—

Instruction Following Not comparable

Gemini 1.0 Pro: 57.6 (#267), Gemma 3 1B: —

Instruction Following benchmarks
BenchmarkGemini 1.0 ProGemma 3 1B
LMArena Instruction Following1114—

Long Context Not comparable

Gemini 1.0 Pro: 34.3 (#249), Gemma 3 1B: —

Long Context benchmarks
BenchmarkGemini 1.0 ProGemma 3 1B
LMArena Longer Query1132—

Writing & Preference Not comparable

Gemini 1.0 Pro: 36.0 (#264), Gemma 3 1B: —

Writing & Preference benchmarks
BenchmarkGemini 1.0 ProGemma 3 1B
LMArena Text1149—
LMArena Creative Writing1131—
LMArena Multi-Turn1139—

Frequently asked questions

Is Gemini 1.0 Pro better than Gemma 3 1B?

Gemini 1.0 Pro is the stronger model overall, scoring 27.3 to 21.1 on the Noometry Index.

How many benchmarks do Gemini 1.0 Pro and Gemma 3 1B share?

2 benchmarks have published results for both models. Gemini 1.0 Pro has 24 scored results on Noometry and Gemma 3 1B has 4.

Related comparisons

Go deeper