Noometry

Model comparison

Gemma 3 27B vs GPT-5.2

GPT-5.2 is the stronger model overall, scoring 54.1 to 30.8 on the Noometry Index. Gemma 3 27B costs 48× less per token, which makes it the better buy when GPT-5.2's lead doesn't matter for your workload.

Last verified . 28 shared benchmarks.

Gemma 3 27B Google

30.8

Rank #284 Confirmed

GPT-5.2 OpenAI

54.1

Rank #34 Confirmed

Summary

  • They share 28 benchmarks with published results for both. Gemma 3 27B scores higher in 0 categories and GPT-5.2 in 10 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.2 leads 60.0 to 25.9.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 22.5% for Gemma 3 27B and 96.1% for GPT-5.2.
  • Gemma 3 27B is cheaper at $0.08 / $0.16 per million input/output tokens, against $1.75 / $14 for GPT-5.2.
  • GPT-5.2 accepts more context: 400K tokens versus 131K.
  • Gemma 3 27B has downloadable open weights; the other is API-only.

Side by side

Gemma 3 27BGPT-5.2
ProviderGoogleOpenAI
Noometry Index30.854.1
Released2025-03-112025-12-11
WeightsOpenProprietary
Context window131K400K
Max output8K128K
Input $ / M tokens$0.08$1.75
Output $ / M tokens$0.16$14
Results tracked4367

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.2 leads

Gemma 3 27B: 22.5 (#334), GPT-5.2: 51.6 (#37)

BenchmarkGemma 3 27BGPT-5.2
LMArena Coding13221447
SWE-bench Verified—73.8%
SWE-bench Verified (bash only)—72.8%
Aider Polyglot4.9%—
LMArena WebDev—1416
SWE-bench Multilingual—66.7%
SciCode21.2%—
GSO—27.4%
WeirdML—72.2%
LiveBench Coding39.9%—
ALE-Bench—1,294
AlgoTune—2.05

Agentic & Tool Use GPT-5.2 leads

Gemma 3 27B: 25.1 (#110), GPT-5.2: 40.2 (#24)

BenchmarkGemma 3 27BGPT-5.2
Berkeley Function Calling Leaderboard29.5%55.9%
Terminal-Bench—64.9%
GDPval—49.7%
Remote Labor Index—2.5%
τ²-bench Airline—83%
τ²-bench Banking—32.2%
τ²-bench Retail—81.6%
τ²-bench Telecom—89.7%
DeepResearch Bench—41.1%
LMArena Search—1207
METR Time Horizons—75.3%
Vending-Bench 2—3,591

Reasoning GPT-5.2 leads

Gemma 3 27B: 16.7 (#301), GPT-5.2: 50.2 (#35)

BenchmarkGemma 3 27BGPT-5.2
Kagi LLM Benchmark40.4%73.3%
Chess Puzzles0%49%
LMArena Hard Prompts13401445
DTBench52.5%90.9%
LMCA12.3%43.9%
Epoch Capabilities Index130.04153.45
ARC-AGI-2—52.9%
SimpleBench—45.8%
NYT Connections (extended)—83.6%
ARC-AGI-1—86.2%
CritPt0%—
EnigmaEval—10.4%
EBR-Bench—23%
LiveBench Reasoning43.8%—
Mystery Game Puzzles—23%
LiveBench Data Analysis51.5%—
ForecastBench—60.1
LiveBench50%—

Math GPT-5.2 leads

Gemma 3 27B: 25.9 (#265), GPT-5.2: 60.0 (#38)

BenchmarkGemma 3 27BGPT-5.2
OTIS Mock AIME 2024-202522.5%96.1%
LMArena Math13121440
FrontierMath (Tiers 1-3)—67.4%
FrontierMath Tier 4—31.7%
MathArena Final-Answer Competitions—72%
ProofBench—15%
LiveBench Math55.4%—
MATH Level 574%—
FrontierMath (Feb 2025 set)—40.7%
FrontierMath Tier 4 (v1)—18.8%

Knowledge GPT-5.2 leads

Gemma 3 27B: 25.5 (#261), GPT-5.2: 59.3 (#32)

BenchmarkGemma 3 27BGPT-5.2
GPQA Diamond47.7%91.4%
Vectara Hallucination Rate7.4%8.4%
LMArena Expert13041445
Humanity's Last Exam—27.8%
SimpleQA Verified—37.1%
Confabulations40.3%—

Multimodal GPT-5.2 leads

Gemma 3 27B: 32.6 (#100), GPT-5.2: 51.3 (#7)

BenchmarkGemma 3 27BGPT-5.2
LMArena Vision11641268
GeoBench52%—
VPCT—84%
Furniture Assembly—38.3%
LMArena Document—1405

Multilingual GPT-5.2 leads

Gemma 3 27B: 46.9 (#155), GPT-5.2: 53.4 (#67)

BenchmarkGemma 3 27BGPT-5.2
LMArena Non-English13341425
LMArena Chinese13461460
LMArena French13681455
LMArena German13621448
LMArena Japanese12871420
LMArena Korean13081392
LMArena Russian13491440
LMArena Spanish13491433

Instruction Following GPT-5.2 leads

Gemma 3 27B: 70.6 (#160), GPT-5.2: 74.7 (#89)

BenchmarkGemma 3 27BGPT-5.2
LMArena Instruction Following13211417
LiveBench Instruction Following74.9%—

Long Context GPT-5.2 leads

Gemma 3 27B: 27.6 (#293), GPT-5.2: 44.0 (#78)

BenchmarkGemma 3 27BGPT-5.2
LMArena Longer Query13331428
Fiction.LiveBench33.3%—
CL-bench—18.2%

Writing & Preference GPT-5.2 leads

Gemma 3 27B: 52.5 (#168), GPT-5.2: 66.8 (#32)

BenchmarkGemma 3 27BGPT-5.2
LMArena Text13581439
LMArena Creative Writing13461401
EQ-Bench Creative Writing12661703
LMArena Multi-Turn13451458
Short-Story Creative Writing79.9%—
LiveBench Language34.6%—

Frequently asked questions

Is Gemma 3 27B better than GPT-5.2?

GPT-5.2 is the stronger model overall, scoring 54.1 to 30.8 on the Noometry Index. Gemma 3 27B costs 48× less per token, which makes it the better buy when GPT-5.2's lead doesn't matter for your workload.

Which is cheaper, Gemma 3 27B or GPT-5.2?

Gemma 3 27B is cheaper. It lists at $0.08 per million input tokens and $0.16 per million output tokens; GPT-5.2 lists at $1.75 and $14.

Is Gemma 3 27B or GPT-5.2 better for coding?

GPT-5.2 scores higher on coding benchmarks: 51.6 versus 22.5 in the Noometry coding category.

Which has the bigger context window?

GPT-5.2 does, with 400K tokens against 131K.

How many benchmarks do Gemma 3 27B and GPT-5.2 share?

28 benchmarks have published results for both models. Gemma 3 27B has 43 scored results on Noometry and GPT-5.2 has 67.

Related comparisons

Go deeper