Model comparison

Gemma 2B vs GPT-5.2 Codex

GPT-5.2 Codex is the stronger model overall, scoring 42.6 to 29.6 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 2B Google

29.6

Rank #307 Confirmed

GPT-5.2 Codex OpenAI

42.6

Rank #111 Reported

Summary

  • The widest gap is in coding, where GPT-5.2 Codex leads 45.5 to 29.4.
  • Gemma 2B has downloadable open weights; the other is API-only.

Side by side

Gemma 2B and GPT-5.2 Codex specifications
Gemma 2BGPT-5.2 Codex
ProviderGoogleOpenAI
Noometry Index29.642.6
Released2024-02-212025-12-18
WeightsOpenProprietary
Context window—400K
Max output—128K
Input $ / M tokens—$1.75
Output $ / M tokens—$14
Results tracked235

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.2 Codex leads

Gemma 2B: 29.4 (#305), GPT-5.2 Codex: 45.5 (#71)

Coding benchmarks
BenchmarkGemma 2BGPT-5.2 Codex
SWE-bench Verified (bash only)—72.8%
LMArena WebDev—1339
SWE-bench Multilingual—66.3%
LMArena Coding1010—
ALE-Bench—1,300
HumanEval+20.7%—
MBPP+34.1%—

Agentic & Tool Use Not comparable

Gemma 2B: —, GPT-5.2 Codex: 41.0 (#22)

Agentic & Tool Use benchmarks
BenchmarkGemma 2BGPT-5.2 Codex
Terminal-Bench—66.5%

Reasoning Not comparable

Gemma 2B: 18.8 (#275), GPT-5.2 Codex: —

Reasoning benchmarks
BenchmarkGemma 2BGPT-5.2 Codex
LMArena Hard Prompts989—
BIG-Bench Hard35.2%—
Epoch Capabilities Index94.2—
HellaSwag71.4%—
PIQA77.3%—
WinoGrande65.4%—

Math Not comparable

Gemma 2B: 30.0 (#239), GPT-5.2 Codex: —

Math benchmarks
BenchmarkGemma 2BGPT-5.2 Codex
LMArena Math1009—
GSM8K17.7%—

Knowledge Not comparable

Gemma 2B: —, GPT-5.2 Codex: —

Knowledge benchmarks
BenchmarkGemma 2BGPT-5.2 Codex
ARC (AI2) Challenge42.1%—
BoolQ69.4%—
MMLU42.3%—
TriviaQA53.2%—

Multilingual Not comparable

Gemma 2B: 23.0 (#294), GPT-5.2 Codex: —

Multilingual benchmarks
BenchmarkGemma 2BGPT-5.2 Codex
LMArena Non-English958—
LMArena Chinese986—
LMArena Russian937—

Instruction Following Not comparable

Gemma 2B: 48.5 (#302), GPT-5.2 Codex: —

Instruction Following benchmarks
BenchmarkGemma 2BGPT-5.2 Codex
LMArena Instruction Following970—

Long Context Not comparable

Gemma 2B: 29.9 (#291), GPT-5.2 Codex: —

Long Context benchmarks
BenchmarkGemma 2BGPT-5.2 Codex
LMArena Longer Query981—

Writing & Preference Not comparable

Gemma 2B: 24.0 (#308), GPT-5.2 Codex: —

Writing & Preference benchmarks
BenchmarkGemma 2BGPT-5.2 Codex
LMArena Text1002—
LMArena Creative Writing987—
LMArena Multi-Turn945—

Frequently asked questions

Is Gemma 2B better than GPT-5.2 Codex?

GPT-5.2 Codex is the stronger model overall, scoring 42.6 to 29.6 on the Noometry Index.

Is Gemma 2B or GPT-5.2 Codex better for coding?

GPT-5.2 Codex scores higher on coding benchmarks: 45.5 versus 29.4 in the Noometry coding category.

How many benchmarks do Gemma 2B and GPT-5.2 Codex share?

0 benchmarks have published results for both models. Gemma 2B has 23 scored results on Noometry and GPT-5.2 Codex has 5.

Related comparisons

Go deeper