Model comparison

GPT-5.2 Pro vs Olmo 7b Instruct

GPT-5.2 Pro is the stronger model overall, scoring 52.2 to 29.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

GPT-5.2 Pro OpenAI

52.2

Rank #34 Reported

Summary

  • The widest gap is in math, where GPT-5.2 Pro leads 64.8 to 27.8.
  • Olmo 7b Instruct has downloadable open weights; the other is API-only.

Side by side

GPT-5.2 Pro and Olmo 7b Instruct specifications
GPT-5.2 ProOlmo 7b Instruct
ProviderOpenAIAllen Institute for AI (Ai2)
Noometry Index52.229.7
Released2025-12-11—
WeightsProprietaryOpen
Context window400K—
Max output128K—
Input $ / M tokens$21—
Output $ / M tokens$168—
Results tracked810

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

GPT-5.2 Pro: —, Olmo 7b Instruct: 29.1 (#298)

Coding benchmarks
BenchmarkGPT-5.2 ProOlmo 7b Instruct
LMArena Coding—1016

Reasoning GPT-5.2 Pro leads

GPT-5.2 Pro: 51.8 (#31), Olmo 7b Instruct: 18.0 (#273)

Reasoning benchmarks
BenchmarkGPT-5.2 ProOlmo 7b Instruct
ARC-AGI-254.2%—
SimpleBench57.4%—
NYT Connections (extended)79.3%—
ARC-AGI-190.5%—
LMArena Hard Prompts—993
Epoch Capabilities Index155.41—

Math GPT-5.2 Pro leads

GPT-5.2 Pro: 64.8 (#23), Olmo 7b Instruct: 27.8 (#234)

Math benchmarks
BenchmarkGPT-5.2 ProOlmo 7b Instruct
FrontierMath (Tiers 1-3)74%—
FrontierMath Tier 446%—
LMArena Math—1018
FrontierMath Tier 4 (v1)31.3%—

Multilingual Not comparable

GPT-5.2 Pro: —, Olmo 7b Instruct: 24.1 (#286)

Multilingual benchmarks
BenchmarkGPT-5.2 ProOlmo 7b Instruct
LMArena Non-English—977
LMArena Chinese—1013
LMArena Russian—946

Instruction Following Not comparable

GPT-5.2 Pro: —, Olmo 7b Instruct: 49.3 (#296)

Instruction Following benchmarks
BenchmarkGPT-5.2 ProOlmo 7b Instruct
LMArena Instruction Following—978

Writing & Preference Not comparable

GPT-5.2 Pro: —, Olmo 7b Instruct: 26.0 (#298)

Writing & Preference benchmarks
BenchmarkGPT-5.2 ProOlmo 7b Instruct
LMArena Text—1032
LMArena Creative Writing—990
LMArena Multi-Turn—1007

Frequently asked questions

Is GPT-5.2 Pro better than Olmo 7b Instruct?

GPT-5.2 Pro is the stronger model overall, scoring 52.2 to 29.7 on the Noometry Index.

How many benchmarks do GPT-5.2 Pro and Olmo 7b Instruct share?

0 benchmarks have published results for both models. GPT-5.2 Pro has 8 scored results on Noometry and Olmo 7b Instruct has 10.

Related comparisons

Go deeper