Model comparison

Gemini 3 Pro vs Llama 3.2 1B

Gemini 3 Pro is the stronger model overall, scoring 54.8 to 20.1 on the Noometry Index.

Last verified . 20 shared benchmarks.

Gemini 3 Pro Google

54.8

Rank #28 Confirmed

Llama 3.2 1B Meta

20.1

Rank #354 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Gemini 3 Pro scores higher in 9 categories and Llama 3.2 1B in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Gemini 3 Pro leads 64.4 to 7.2.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 91.4% for Gemini 3 Pro and 0.6% for Llama 3.2 1B.
  • Llama 3.2 1B has downloadable open weights; the other is API-only.

Side by side

Gemini 3 Pro and Llama 3.2 1B specifications
Gemini 3 ProLlama 3.2 1B
ProviderGoogleMeta
Noometry Index54.820.1
Released2025-11-182024-09-24
WeightsProprietaryOpen
Context window—60K
Max output—54K
Input $ / M tokens—$0.027
Output $ / M tokens—$0.20
Results tracked6722

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3 Pro leads

Gemini 3 Pro: 51.6 (#39), Llama 3.2 1B: 21.1 (#338)

Coding benchmarks
BenchmarkGemini 3 ProLlama 3.2 1B
LMArena Coding14811070
SWE-bench Verified72.9%—
SWE-bench Verified (bash only)74.2%—
LMArena WebDev1440—
SWE-bench Multilingual68.7%—
GSO18.6%—
WeirdML69.9%—
BigCodeBench Instruct—8.2%
BigCodeBench Complete—11.3%
ALE-Bench1,177—
AlgoTune1.83—

Agentic & Tool Use Gemini 3 Pro leads

Gemini 3 Pro: 40.6 (#23), Llama 3.2 1B: 14.6 (#150)

Agentic & Tool Use benchmarks
BenchmarkGemini 3 ProLlama 3.2 1B
Berkeley Function Calling Leaderboard72.5%10.8%
BALROG58.1%6.6%
Terminal-Bench69.4%—
GDPval40.3%—
Remote Labor Index1.3%—
τ²-bench Airline80.5%—
τ²-bench Banking18%—
τ²-bench Retail75.9%—
τ²-bench Telecom91%—
DeepResearch Bench46.3%—
LMArena Search1207—
METR Time Horizons71%—
Vending-Bench 25,478—

Reasoning Gemini 3 Pro leads

Gemini 3 Pro: 52.5 (#31), Llama 3.2 1B: 16.2 (#308)

Reasoning benchmarks
BenchmarkGemini 3 ProLlama 3.2 1B
Chess Puzzles31%0%
LMArena Hard Prompts14801044
Epoch Capabilities Index152.92101.99
ARC-AGI-231.1%—
SimpleBench76.4%—
Kagi LLM Benchmark80.1%—
NYT Connections (extended)94.4%—
ARC-AGI-175%—
CritPt6.9%—
EnigmaEval18.2%—
ForecastBench61.2—

Math Gemini 3 Pro leads

Gemini 3 Pro: 49.9 (#59), Llama 3.2 1B: 10.4 (#313)

Math benchmarks
BenchmarkGemini 3 ProLlama 3.2 1B
OTIS Mock AIME 2024-202591.4%0.6%
LMArena Math14761086
MathArena Final-Answer Competitions67%—
ProofBench20%—
Omni-MATH55.5%—
FrontierMath (Feb 2025 set)37.6%—
FrontierMath Tier 4 (v1)18.8%—

Knowledge Gemini 3 Pro leads

Gemini 3 Pro: 64.4 (#16), Llama 3.2 1B: 7.2 (#312)

Knowledge benchmarks
BenchmarkGemini 3 ProLlama 3.2 1B
GPQA Diamond92.6%23.9%
LMArena Expert14751007
Humanity's Last Exam37.5%—
MMLU-Pro90.3%—
Vectara Hallucination Rate13.6%—
GPQA (HELM)80.3%—

Multimodal Not comparable

Gemini 3 Pro: 57.6 (#2), Llama 3.2 1B: —

Multimodal benchmarks
BenchmarkGemini 3 ProLlama 3.2 1B
LMArena Vision1305—
GeoBench84%—
VPCT91%—
LMArena Document1434—

Multilingual Gemini 3 Pro leads

Gemini 3 Pro: 56.9 (#16), Llama 3.2 1B: 23.8 (#292)

Multilingual benchmarks
BenchmarkGemini 3 ProLlama 3.2 1B
LMArena Non-English1474973
LMArena Chinese1523959
LMArena German15151014
LMArena Russian1493941
LMArena French1492—
LMArena Japanese1510—
LMArena Korean1448—
LMArena Spanish1470—

Instruction Following Gemini 3 Pro leads

Gemini 3 Pro: 76.3 (#45), Llama 3.2 1B: 52.4 (#290)

Instruction Following benchmarks
BenchmarkGemini 3 ProLlama 3.2 1B
LMArena Instruction Following14581031
IFEval87.7%—

Long Context Gemini 3 Pro leads

Gemini 3 Pro: 44.0 (#79), Llama 3.2 1B: 31.9 (#274)

Long Context benchmarks
BenchmarkGemini 3 ProLlama 3.2 1B
LMArena Longer Query14711050
CL-bench15.8%—

Writing & Preference Gemini 3 Pro leads

Gemini 3 Pro: 66.4 (#35), Llama 3.2 1B: 21.3 (#310)

Writing & Preference benchmarks
BenchmarkGemini 3 ProLlama 3.2 1B
LMArena Text14791055
LMArena Creative Writing14821033
EQ-Bench Creative Writing1525200
LMArena Multi-Turn14841030
WildBench85.9%—

Frequently asked questions

Is Gemini 3 Pro better than Llama 3.2 1B?

Gemini 3 Pro is the stronger model overall, scoring 54.8 to 20.1 on the Noometry Index.

Is Gemini 3 Pro or Llama 3.2 1B better for coding?

Gemini 3 Pro scores higher on coding benchmarks: 51.6 versus 21.1 in the Noometry coding category.

How many benchmarks do Gemini 3 Pro and Llama 3.2 1B share?

20 benchmarks have published results for both models. Gemini 3 Pro has 67 scored results on Noometry and Llama 3.2 1B has 22.

Related comparisons

Go deeper