Model comparison

Gemma 3 27B vs GPT-5.2 Codex

GPT-5.2 Codex is the stronger model overall, scoring 42.6 to 30.8 on the Noometry Index. Gemma 3 27B costs 48× less per token, which makes it the better buy when GPT-5.2 Codex's lead doesn't matter for your workload.

Last verified . 0 shared benchmarks.

Gemma 3 27B Google

30.8

Rank #284 Confirmed

GPT-5.2 Codex OpenAI

42.6

Rank #111 Reported

Summary

  • The widest gap is in coding, where GPT-5.2 Codex leads 45.5 to 22.5.
  • Gemma 3 27B is cheaper at $0.08 / $0.16 per million input/output tokens, against $1.75 / $14 for GPT-5.2 Codex.
  • GPT-5.2 Codex accepts more context: 400K tokens versus 131K.
  • Gemma 3 27B has downloadable open weights; the other is API-only.

Side by side

Gemma 3 27B and GPT-5.2 Codex specifications
Gemma 3 27BGPT-5.2 Codex
ProviderGoogleOpenAI
Noometry Index30.842.6
Released2025-03-112025-12-18
WeightsOpenProprietary
Context window131K400K
Max output8K128K
Input $ / M tokens$0.08$1.75
Output $ / M tokens$0.16$14
Results tracked435

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.2 Codex leads

Gemma 3 27B: 22.5 (#334), GPT-5.2 Codex: 45.5 (#71)

Coding benchmarks
BenchmarkGemma 3 27BGPT-5.2 Codex
SWE-bench Verified (bash only)—72.8%
Aider Polyglot4.9%—
LMArena WebDev—1339
SWE-bench Multilingual—66.3%
SciCode21.2%—
LiveBench Coding39.9%—
LMArena Coding1322—
ALE-Bench—1,300

Agentic & Tool Use GPT-5.2 Codex leads

Gemma 3 27B: 25.1 (#110), GPT-5.2 Codex: 41.0 (#22)

Agentic & Tool Use benchmarks
BenchmarkGemma 3 27BGPT-5.2 Codex
Terminal-Bench—66.5%
Berkeley Function Calling Leaderboard29.5%—

Reasoning Not comparable

Gemma 3 27B: 16.7 (#301), GPT-5.2 Codex: —

Reasoning benchmarks
BenchmarkGemma 3 27BGPT-5.2 Codex
Kagi LLM Benchmark40.4%—
CritPt0%—
Chess Puzzles0%—
LiveBench Reasoning43.8%—
LMArena Hard Prompts1340—
DTBench52.5%—
LiveBench Data Analysis51.5%—
LMCA12.3%—
Epoch Capabilities Index130.04—
LiveBench50%—

Math Not comparable

Gemma 3 27B: 25.9 (#265), GPT-5.2 Codex: —

Math benchmarks
BenchmarkGemma 3 27BGPT-5.2 Codex
OTIS Mock AIME 2024-202522.5%—
LiveBench Math55.4%—
LMArena Math1312—
MATH Level 574%—

Knowledge Not comparable

Gemma 3 27B: 25.5 (#261), GPT-5.2 Codex: —

Knowledge benchmarks
BenchmarkGemma 3 27BGPT-5.2 Codex
GPQA Diamond47.7%—
Confabulations40.3%—
Vectara Hallucination Rate7.4%—
LMArena Expert1304—

Multimodal Not comparable

Gemma 3 27B: 32.6 (#100), GPT-5.2 Codex: —

Multimodal benchmarks
BenchmarkGemma 3 27BGPT-5.2 Codex
LMArena Vision1164—
GeoBench52%—

Multilingual Not comparable

Gemma 3 27B: 46.9 (#155), GPT-5.2 Codex: —

Multilingual benchmarks
BenchmarkGemma 3 27BGPT-5.2 Codex
LMArena Non-English1334—
LMArena Chinese1346—
LMArena French1368—
LMArena German1362—
LMArena Japanese1287—
LMArena Korean1308—
LMArena Russian1349—
LMArena Spanish1349—

Instruction Following Not comparable

Gemma 3 27B: 70.6 (#160), GPT-5.2 Codex: —

Instruction Following benchmarks
BenchmarkGemma 3 27BGPT-5.2 Codex
LiveBench Instruction Following74.9%—
LMArena Instruction Following1321—

Long Context Not comparable

Gemma 3 27B: 27.6 (#293), GPT-5.2 Codex: —

Long Context benchmarks
BenchmarkGemma 3 27BGPT-5.2 Codex
Fiction.LiveBench33.3%—
LMArena Longer Query1333—

Writing & Preference Not comparable

Gemma 3 27B: 52.5 (#168), GPT-5.2 Codex: —

Writing & Preference benchmarks
BenchmarkGemma 3 27BGPT-5.2 Codex
LMArena Text1358—
LMArena Creative Writing1346—
Short-Story Creative Writing79.9%—
EQ-Bench Creative Writing1266—
LMArena Multi-Turn1345—
LiveBench Language34.6%—

Frequently asked questions

Is Gemma 3 27B better than GPT-5.2 Codex?

GPT-5.2 Codex is the stronger model overall, scoring 42.6 to 30.8 on the Noometry Index. Gemma 3 27B costs 48× less per token, which makes it the better buy when GPT-5.2 Codex's lead doesn't matter for your workload.

Which is cheaper, Gemma 3 27B or GPT-5.2 Codex?

Gemma 3 27B is cheaper. It lists at $0.08 per million input tokens and $0.16 per million output tokens; GPT-5.2 Codex lists at $1.75 and $14.

Is Gemma 3 27B or GPT-5.2 Codex better for coding?

GPT-5.2 Codex scores higher on coding benchmarks: 45.5 versus 22.5 in the Noometry coding category.

Which has the bigger context window?

GPT-5.2 Codex does, with 400K tokens against 131K.

How many benchmarks do Gemma 3 27B and GPT-5.2 Codex share?

0 benchmarks have published results for both models. Gemma 3 27B has 43 scored results on Noometry and GPT-5.2 Codex has 5.

Related comparisons

Go deeper