Noometry

Model comparison

Gemini 1.0 Pro vs gpt-oss-120b

gpt-oss-120b is the stronger model overall, scoring 36.3 to 27.3 on the Noometry Index.

Last verified . 20 shared benchmarks.

Gemini 1.0 Pro Google

27.3

Rank #332 Confirmed

gpt-oss-120b OpenAI

36.3

Rank #217 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Gemini 1.0 Pro scores higher in 1 category and gpt-oss-120b in 7 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where gpt-oss-120b leads 52.5 to 9.3.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.1% for Gemini 1.0 Pro and 88.9% for gpt-oss-120b.
  • gpt-oss-120b has downloadable open weights; the other is API-only.

Side by side

Gemini 1.0 Progpt-oss-120b
ProviderGoogleOpenAI
Noometry Index27.336.3
Released2023-12-132025-08-05
WeightsProprietaryOpen
Context window—131K
Max output—41K
Input $ / M tokens—$0.037
Output $ / M tokens—$0.17
Results tracked2448

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding gpt-oss-120b leads

Gemini 1.0 Pro: 32.2 (#275), gpt-oss-120b: 33.5 (#256)

BenchmarkGemini 1.0 Progpt-oss-120b
LMArena Coding11081380
SWE-bench Verified (bash only)—26%
Aider Polyglot—41.8%
SciCode—36%
WeirdML—48.2%
ALE-Bench—575.62
AlgoTune—1.41
HumanEval+55.5%—
MBPP+61.4%—

Agentic & Tool Use Not comparable

Gemini 1.0 Pro: —, gpt-oss-120b: 12.2 (#153)

BenchmarkGemini 1.0 Progpt-oss-120b
Terminal-Bench—18.7%
APEX-Agents—4.4%
METR Time Horizons—56.6%
Vending-Bench 2—-21.53

Reasoning gpt-oss-120b leads

Gemini 1.0 Pro: 17.1 (#296), gpt-oss-120b: 20.0 (#245)

BenchmarkGemini 1.0 Progpt-oss-120b
LMArena Hard Prompts11091364
DTBench45.9%76.3%
Epoch Capabilities Index117.04139.93
SimpleBench—22.1%
Kagi LLM Benchmark—58.6%
CritPt—1.1%
Chess Puzzles—20%
Mystery Game Puzzles—2%
LMCA—22.1%
Surface Evolver Bench—25%

Math gpt-oss-120b leads

Gemini 1.0 Pro: 9.3 (#321), gpt-oss-120b: 52.5 (#50)

BenchmarkGemini 1.0 Progpt-oss-120b
OTIS Mock AIME 2024-20251.1%88.9%
LMArena Math11321389
Omni-MATH—68.8%
MATH Level 511.2%—

Knowledge gpt-oss-120b leads

Gemini 1.0 Pro: 15.6 (#291), gpt-oss-120b: 42.4 (#96)

BenchmarkGemini 1.0 Progpt-oss-120b
GPQA Diamond34%75.8%
LMArena Expert10591356
MMLU-Pro—79.5%
Confabulations—15.7%
Vectara Hallucination Rate—14.2%
GPQA (HELM)—68.4%
MMLU70%—

Multilingual gpt-oss-120b leads

Gemini 1.0 Pro: 33.4 (#252), gpt-oss-120b: 48.0 (#147)

BenchmarkGemini 1.0 Progpt-oss-120b
LMArena Non-English11381351
LMArena Chinese11241385
LMArena French11451369
LMArena German11251353
LMArena Japanese10231331
LMArena Russian11861343
LMArena Spanish11191389
LMArena Korean—1282

Instruction Following gpt-oss-120b leads

Gemini 1.0 Pro: 57.6 (#267), gpt-oss-120b: 69.3 (#173)

BenchmarkGemini 1.0 Progpt-oss-120b
LMArena Instruction Following11141318
IFEval—83.6%

Long Context Gemini 1.0 Pro leads

Gemini 1.0 Pro: 34.3 (#249), gpt-oss-120b: 31.4 (#278)

BenchmarkGemini 1.0 Progpt-oss-120b
LMArena Longer Query11321319
Fiction.LiveBench—44.4%

Writing & Preference gpt-oss-120b leads

Gemini 1.0 Pro: 36.0 (#264), gpt-oss-120b: 46.5 (#217)

BenchmarkGemini 1.0 Progpt-oss-120b
LMArena Text11491365
LMArena Creative Writing11311275
LMArena Multi-Turn11391340
Short-Story Creative Writing—77.1%
EQ-Bench Creative Writing—961
WildBench—84.5%

Frequently asked questions

Is Gemini 1.0 Pro better than gpt-oss-120b?

gpt-oss-120b is the stronger model overall, scoring 36.3 to 27.3 on the Noometry Index.

Is Gemini 1.0 Pro or gpt-oss-120b better for coding?

gpt-oss-120b scores higher on coding benchmarks: 33.5 versus 32.2 in the Noometry coding category.

How many benchmarks do Gemini 1.0 Pro and gpt-oss-120b share?

20 benchmarks have published results for both models. Gemini 1.0 Pro has 24 scored results on Noometry and gpt-oss-120b has 48.

Related comparisons

Go deeper