Model comparison

Gemma 1.1 2b IT vs GPT-5.3 Codex

GPT-5.3 Codex is the stronger model overall, scoring 45.8 to 29.3 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 1.1 2b IT Google

29.3

Rank #313 Confirmed

GPT-5.3 Codex OpenAI

45.8

Rank #69 Reported

Summary

  • The widest gap is in coding, where GPT-5.3 Codex leads 48.6 to 30.1.
  • Gemma 1.1 2b IT has downloadable open weights; the other is API-only.

Side by side

Gemma 1.1 2b IT and GPT-5.3 Codex specifications
Gemma 1.1 2b ITGPT-5.3 Codex
ProviderGoogleOpenAI
Noometry Index29.345.8
Released—2026-02-05
WeightsOpenProprietary
Context window—400K
Max output—128K
Input $ / M tokens—$1.75
Output $ / M tokens—$14
Results tracked168

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.3 Codex leads

Gemma 1.1 2b IT: 30.1 (#299), GPT-5.3 Codex: 48.6 (#56)

Coding benchmarks
BenchmarkGemma 1.1 2b ITGPT-5.3 Codex
SWE-bench Verified—74.8%
LMArena WebDev—1409
WeirdML—79.3%
LMArena Coding1034—
ALE-Bench—1,655
HumanEval+17.7%—
MBPP+23.3%—

Agentic & Tool Use Not comparable

Gemma 1.1 2b IT: —, GPT-5.3 Codex: 48.0 (#9)

Agentic & Tool Use benchmarks
BenchmarkGemma 1.1 2b ITGPT-5.3 Codex
Terminal-Bench—78.4%
METR Time Horizons—74.5%
Vending-Bench 2—5,940

Reasoning Not comparable

Gemma 1.1 2b IT: 19.1 (#270), GPT-5.3 Codex: —

Reasoning benchmarks
BenchmarkGemma 1.1 2b ITGPT-5.3 Codex
LMArena Hard Prompts1005—
Epoch Capabilities Index—156.77

Math Not comparable

Gemma 1.1 2b IT: 30.8 (#232), GPT-5.3 Codex: —

Math benchmarks
BenchmarkGemma 1.1 2b ITGPT-5.3 Codex
LMArena Math1047—

Knowledge Not comparable

Gemma 1.1 2b IT: 26.5 (#258), GPT-5.3 Codex: —

Knowledge benchmarks
BenchmarkGemma 1.1 2b ITGPT-5.3 Codex
LMArena Expert970—

Multilingual Not comparable

Gemma 1.1 2b IT: 24.6 (#289), GPT-5.3 Codex: —

Multilingual benchmarks
BenchmarkGemma 1.1 2b ITGPT-5.3 Codex
LMArena Non-English988—
LMArena Chinese1012—
LMArena German944—
LMArena Korean899—
LMArena Russian990—

Instruction Following Not comparable

Gemma 1.1 2b IT: 49.9 (#299), GPT-5.3 Codex: —

Instruction Following benchmarks
BenchmarkGemma 1.1 2b ITGPT-5.3 Codex
LMArena Instruction Following992—

Long Context Not comparable

Gemma 1.1 2b IT: 30.6 (#286), GPT-5.3 Codex: —

Long Context benchmarks
BenchmarkGemma 1.1 2b ITGPT-5.3 Codex
LMArena Longer Query1003—

Writing & Preference Not comparable

Gemma 1.1 2b IT: 25.1 (#306), GPT-5.3 Codex: —

Writing & Preference benchmarks
BenchmarkGemma 1.1 2b ITGPT-5.3 Codex
LMArena Text1022—
LMArena Creative Writing998—
LMArena Multi-Turn959—

Frequently asked questions

Is Gemma 1.1 2b IT better than GPT-5.3 Codex?

GPT-5.3 Codex is the stronger model overall, scoring 45.8 to 29.3 on the Noometry Index.

Is Gemma 1.1 2b IT or GPT-5.3 Codex better for coding?

GPT-5.3 Codex scores higher on coding benchmarks: 48.6 versus 30.1 in the Noometry coding category.

How many benchmarks do Gemma 1.1 2b IT and GPT-5.3 Codex share?

0 benchmarks have published results for both models. Gemma 1.1 2b IT has 16 scored results on Noometry and GPT-5.3 Codex has 8.

Related comparisons

Go deeper