Noometry

Model comparison

Gemma 2 27B vs GPT-5.5 Instant

GPT-5.5 Instant is the stronger model overall, scoring 42.7 to 29.4 on the Noometry Index.

Last verified . 20 shared benchmarks.

Gemma 2 27B Google

29.4

Rank #312 Confirmed

GPT-5.5 Instant OpenAI

42.7

Rank #110 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Gemma 2 27B scores higher in 0 categories and GPT-5.5 Instant in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where GPT-5.5 Instant leads 48.9 to 19.0.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.4% for Gemma 2 27B and 68.1% for GPT-5.5 Instant.
  • Gemma 2 27B has downloadable open weights; the other is API-only.

Side by side

Gemma 2 27BGPT-5.5 Instant
ProviderGoogleOpenAI
Noometry Index29.442.7
Released2024-06-242026-05-05
WeightsOpenProprietary
Context window8K—
Max output2K—
Input $ / M tokens$0.65—
Output $ / M tokens$0.65—
Results tracked3427

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.5 Instant leads

Gemma 2 27B: 34.1 (#246), GPT-5.5 Instant: 44.3 (#74)

BenchmarkGemma 2 27BGPT-5.5 Instant
LMArena Coding12111433
SciCode—48.6%
BigCodeBench Instruct42.8%—
LiveBench Coding36%—
BigCodeBench Complete52.5%—

Reasoning GPT-5.5 Instant leads

Gemma 2 27B: 15.3 (#315), GPT-5.5 Instant: 24.9 (#155)

BenchmarkGemma 2 27BGPT-5.5 Instant
LMArena Hard Prompts11981426
Epoch Capabilities Index122.08142.52
CritPt—0%
Chess Puzzles—12%
LiveBench Reasoning28.1%—
DTBench48%—
LiveBench Data Analysis47.9%—
LMCA7.1%—
LiveBench38.2%—

Math GPT-5.5 Instant leads

Gemma 2 27B: 10.7 (#311), GPT-5.5 Instant: 26.5 (#259)

BenchmarkGemma 2 27BGPT-5.5 Instant
OTIS Mock AIME 2024-20251.4%68.1%
LMArena Math12121420
FrontierMath (Tiers 1-3)—26.3%
FrontierMath Tier 4—2.4%
LiveBench Math26.5%—
MATH Level 527.9%—

Knowledge GPT-5.5 Instant leads

Gemma 2 27B: 19.0 (#280), GPT-5.5 Instant: 48.9 (#74)

BenchmarkGemma 2 27BGPT-5.5 Instant
GPQA Diamond36.5%82.5%
LMArena Expert11721409
Confabulations27.1%—
MMLU75.7%—

Multimodal Not comparable

Gemma 2 27B: —, GPT-5.5 Instant: 40.0 (#52)

BenchmarkGemma 2 27BGPT-5.5 Instant
LMArena Vision—1250
LMArena Document—1403

Multilingual GPT-5.5 Instant leads

Gemma 2 27B: 38.6 (#226), GPT-5.5 Instant: 52.8 (#80)

BenchmarkGemma 2 27BGPT-5.5 Instant
LMArena Non-English12171417
LMArena Chinese12211456
LMArena French12471428
LMArena German12091411
LMArena Japanese11751408
LMArena Korean11741392
LMArena Russian12341431
LMArena Spanish12281429

Instruction Following GPT-5.5 Instant leads

Gemma 2 27B: 60.5 (#249), GPT-5.5 Instant: 74.2 (#100)

BenchmarkGemma 2 27BGPT-5.5 Instant
LMArena Instruction Following12061406
LiveBench Instruction Following58.1%—

Long Context GPT-5.5 Instant leads

Gemma 2 27B: 37.3 (#218), GPT-5.5 Instant: 43.4 (#96)

BenchmarkGemma 2 27BGPT-5.5 Instant
LMArena Longer Query12311422

Writing & Preference GPT-5.5 Instant leads

Gemma 2 27B: 44.2 (#225), GPT-5.5 Instant: 61.8 (#85)

BenchmarkGemma 2 27BGPT-5.5 Instant
LMArena Text12311419
LMArena Creative Writing12411419
LMArena Multi-Turn12241433
LiveBench Language32.6%—

Frequently asked questions

Is Gemma 2 27B better than GPT-5.5 Instant?

GPT-5.5 Instant is the stronger model overall, scoring 42.7 to 29.4 on the Noometry Index.

Is Gemma 2 27B or GPT-5.5 Instant better for coding?

GPT-5.5 Instant scores higher on coding benchmarks: 44.3 versus 34.1 in the Noometry coding category.

How many benchmarks do Gemma 2 27B and GPT-5.5 Instant share?

20 benchmarks have published results for both models. Gemma 2 27B has 34 scored results on Noometry and GPT-5.5 Instant has 27.

Related comparisons

Go deeper