Model comparison

Gemma 2 9B vs GPT-5.2 Codex

GPT-5.2 Codex is the stronger model overall, scoring 42.2 to 25.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 2 9B Google

25.7

Rank #334 Confirmed

GPT-5.2 Codex OpenAI

42.2

Rank #107 Reported

Summary

  • The widest gap is in coding, where GPT-5.2 Codex leads 45.4 to 29.0.
  • Gemma 2 9B has downloadable open weights; the other is API-only.

Side by side

Gemma 2 9B and GPT-5.2 Codex specifications
Gemma 2 9BGPT-5.2 Codex
ProviderGoogleOpenAI
Noometry Index25.742.2
Released2024-06-242025-12-18
WeightsOpenProprietary
Context window—400K
Max output—128K
Input $ / M tokens—$1.75
Output $ / M tokens—$14
Results tracked355

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.2 Codex leads

Gemma 2 9B: 29.0 (#299), GPT-5.2 Codex: 45.4 (#66)

Coding benchmarks
BenchmarkGemma 2 9BGPT-5.2 Codex
SWE-bench Verified (bash only)—72.8%
LMArena WebDev—1339
SWE-bench Multilingual—66.3%
BigCodeBench Instruct34.7%—
LiveBench Coding22.5%—
LMArena Coding1174—
BigCodeBench Complete40.6%—
ALE-Bench—1,300

Agentic & Tool Use Not comparable

Gemma 2 9B: —, GPT-5.2 Codex: 40.7 (#20)

Agentic & Tool Use benchmarks
BenchmarkGemma 2 9BGPT-5.2 Codex
Terminal-Bench—66.5%

Reasoning Not comparable

Gemma 2 9B: 15.3 (#306), GPT-5.2 Codex: —

Reasoning benchmarks
BenchmarkGemma 2 9BGPT-5.2 Codex
LiveBench Reasoning15.2%—
LMArena Hard Prompts1172—
LiveBench Data Analysis36.4%—
Epoch Capabilities Index119.78—
LiveBench28.7%—
PIQA83.7%—

Math Not comparable

Gemma 2 9B: 9.3 (#312), GPT-5.2 Codex: —

Math benchmarks
BenchmarkGemma 2 9BGPT-5.2 Codex
OTIS Mock AIME 2024-20250.6%—
LiveBench Math19.8%—
LMArena Math1183—
MATH Level 521%—
GSM8K84.9%—

Knowledge Not comparable

Gemma 2 9B: 9.7 (#300), GPT-5.2 Codex: —

Knowledge benchmarks
BenchmarkGemma 2 9BGPT-5.2 Codex
GPQA Diamond27.5%—
LMArena Expert1147—
BoolQ85.7%—
MMLU72.1%—

Multilingual Not comparable

Gemma 2 9B: 36.8 (#233), GPT-5.2 Codex: —

Multilingual benchmarks
BenchmarkGemma 2 9BGPT-5.2 Codex
LMArena Non-English1188—
LMArena Chinese1185—
LMArena French1189—
LMArena German1186—
LMArena Japanese1144—
LMArena Korean1137—
LMArena Russian1200—
LMArena Spanish1200—

Instruction Following Not comparable

Gemma 2 9B: 57.8 (#264), GPT-5.2 Codex: —

Instruction Following benchmarks
BenchmarkGemma 2 9BGPT-5.2 Codex
LiveBench Instruction Following52.6%—
LMArena Instruction Following1178—

Long Context Not comparable

Gemma 2 9B: 36.3 (#228), GPT-5.2 Codex: —

Long Context benchmarks
BenchmarkGemma 2 9BGPT-5.2 Codex
LMArena Longer Query1197—

Writing & Preference Not comparable

Gemma 2 9B: 32.3 (#276), GPT-5.2 Codex: —

Writing & Preference benchmarks
BenchmarkGemma 2 9BGPT-5.2 Codex
LMArena Text1207—
LMArena Creative Writing1206—
EQ-Bench Creative Writing841—
LMArena Multi-Turn1193—
LiveBench Language25.5%—

Frequently asked questions

Is Gemma 2 9B better than GPT-5.2 Codex?

GPT-5.2 Codex is the stronger model overall, scoring 42.2 to 25.7 on the Noometry Index.

Is Gemma 2 9B or GPT-5.2 Codex better for coding?

GPT-5.2 Codex scores higher on coding benchmarks: 45.4 versus 29.0 in the Noometry coding category.

How many benchmarks do Gemma 2 9B and GPT-5.2 Codex share?

0 benchmarks have published results for both models. Gemma 2 9B has 35 scored results on Noometry and GPT-5.2 Codex has 5.

Related comparisons

Go deeper