Noometry

Model comparison

Gemma 4 31B IT vs GPT-5.5 Instant

Gemma 4 31B IT and GPT-5.5 Instant score almost the same on the Noometry Index (43.2 vs 42.5), so choose on price, context window or the category you care about most.

Last verified . 22 shared benchmarks.

Gemma 4 31B IT Google

43.2

Rank #85 Confirmed

GPT-5.5 Instant OpenAI

42.5

Rank #99 Confirmed

Summary

  • They share 22 benchmarks with published results for both. Gemma 4 31B IT scores higher in 6 categories and GPT-5.5 Instant in 3 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Gemma 4 31B IT leads 41.3 to 26.1.
  • The biggest single-benchmark swing is Chess Puzzles: 5% for Gemma 4 31B IT and 12% for GPT-5.5 Instant.
  • Gemma 4 31B IT has downloadable open weights; the other is API-only.

Side by side

Gemma 4 31B ITGPT-5.5 Instant
ProviderGoogleOpenAI
Noometry Index43.242.5
Released2026-04-022026-05-05
WeightsOpenProprietary
Context window262K—
Max output33K—
Input $ / M tokens$0.09—
Output $ / M tokens$0.34—
Results tracked3527

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.5 Instant leads

Gemma 4 31B IT: 41.9 (#98), GPT-5.5 Instant: 43.7 (#73)

BenchmarkGemma 4 31B ITGPT-5.5 Instant
SciCode43.4%48.6%
LMArena Coding14591433
LMArena WebDev1364—
WeirdML52.3%—
ALE-Bench925.5—

Reasoning Gemma 4 31B IT leads

Gemma 4 31B IT: 26.4 (#119), GPT-5.5 Instant: 24.2 (#149)

BenchmarkGemma 4 31B ITGPT-5.5 Instant
CritPt1.4%0%
Chess Puzzles5%12%
LMArena Hard Prompts14481426
Epoch Capabilities Index142.74142.48
Kagi LLM Benchmark63.5%—
NYT Connections (extended)70.6%—
Thematic Generalization53%—
DTBench82.7%—
LMCA39.3%—
Surface Evolver Bench30.6%—

Math Gemma 4 31B IT leads

Gemma 4 31B IT: 41.3 (#72), GPT-5.5 Instant: 26.1 (#241)

BenchmarkGemma 4 31B ITGPT-5.5 Instant
OTIS Mock AIME 2024-202573.3%68.1%
LMArena Math14641420
FrontierMath (Tiers 1-3)—26.3%
FrontierMath Tier 4—2.4%

Knowledge GPT-5.5 Instant leads

Gemma 4 31B IT: 37.9 (#141), GPT-5.5 Instant: 48.9 (#68)

BenchmarkGemma 4 31B ITGPT-5.5 Instant
GPQA Diamond75.8%82.5%
LMArena Expert14651409
SimpleQA Verified10.4%—
Vectara Hallucination Rate7.4%—

Multimodal Gemma 4 31B IT leads

Gemma 4 31B IT: 41.0 (#32), GPT-5.5 Instant: 39.3 (#48)

BenchmarkGemma 4 31B ITGPT-5.5 Instant
LMArena Vision12781250
LMArena Document14251403

Multilingual Gemma 4 31B IT leads

Gemma 4 31B IT: 54.0 (#52), GPT-5.5 Instant: 53.0 (#76)

BenchmarkGemma 4 31B ITGPT-5.5 Instant
LMArena Non-English14311417
LMArena Chinese14781457
LMArena French14361428
LMArena Russian14621430
LMArena Spanish14431430
LMArena German—1410
LMArena Japanese—1408
LMArena Korean—1393

Instruction Following Gemma 4 31B IT leads

Gemma 4 31B IT: 75.6 (#58), GPT-5.5 Instant: 74.4 (#94)

BenchmarkGemma 4 31B ITGPT-5.5 Instant
LMArena Instruction Following14331407

Long Context Too close to call

Gemma 4 31B IT: 44.2 (#67), GPT-5.5 Instant: 43.4 (#92)

BenchmarkGemma 4 31B ITGPT-5.5 Instant
LMArena Longer Query14461422

Writing & Preference GPT-5.5 Instant leads

Gemma 4 31B IT: 60.7 (#92), GPT-5.5 Instant: 62.0 (#81)

BenchmarkGemma 4 31B ITGPT-5.5 Instant
LMArena Text14431419
LMArena Creative Writing14161420
LMArena Multi-Turn14521434
EQ-Bench Creative Writing1368—
EQ-Bench 41120—

Frequently asked questions

Is Gemma 4 31B IT better than GPT-5.5 Instant?

Gemma 4 31B IT and GPT-5.5 Instant score almost the same on the Noometry Index (43.2 vs 42.5), so choose on price, context window or the category you care about most.

Is Gemma 4 31B IT or GPT-5.5 Instant better for coding?

GPT-5.5 Instant scores higher on coding benchmarks: 43.7 versus 41.9 in the Noometry coding category.

How many benchmarks do Gemma 4 31B IT and GPT-5.5 Instant share?

22 benchmarks have published results for both models. Gemma 4 31B IT has 35 scored results on Noometry and GPT-5.5 Instant has 27.

Related comparisons

Go deeper