Model comparison

GPT-5.1-Codex vs OLMo 2 Furious 13B

GPT-5.1-Codex is the stronger model overall, scoring 38.2 to 29.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

GPT-5.1-Codex OpenAI

38.2

Rank #178 Reported

Summary

  • The widest gap is in coding, where GPT-5.1-Codex leads 41.7 to 28.1.
  • OLMo 2 Furious 13B has downloadable open weights; the other is API-only.

Side by side

GPT-5.1-Codex and OLMo 2 Furious 13B specifications
GPT-5.1-CodexOLMo 2 Furious 13B
ProviderOpenAIAllen Institute for AI (Ai2)
Noometry Index38.229.2
Released2025-11-122024-12-31
WeightsProprietaryOpen
Context window400K—
Max output128K—
Input $ / M tokens$1.25—
Output $ / M tokens$10—
Results tracked612

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.1-Codex leads

GPT-5.1-Codex: 41.7 (#107), OLMo 2 Furious 13B: 28.1 (#309)

Coding benchmarks
BenchmarkGPT-5.1-CodexOLMo 2 Furious 13B
SWE-bench Verified (bash only)66%—
LMArena WebDev1337—
LiveBench Coding—10.4%
ALE-Bench1,245—

Agentic & Tool Use Not comparable

GPT-5.1-Codex: 37.8 (#32), OLMo 2 Furious 13B: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.1-CodexOLMo 2 Furious 13B
Terminal-Bench60.4%—
METR Time Horizons70.8%—

Reasoning Not comparable

GPT-5.1-Codex: —, OLMo 2 Furious 13B: 14.8 (#312)

Reasoning benchmarks
BenchmarkGPT-5.1-CodexOLMo 2 Furious 13B
LiveBench Reasoning—16.3%
LiveBench Data Analysis—20.6%
LiveBench—22.1%

Math GPT-5.1-Codex leads

GPT-5.1-Codex: 29.3 (#218), OLMo 2 Furious 13B: 21.3 (#270)

Math benchmarks
BenchmarkGPT-5.1-CodexOLMo 2 Furious 13B
ProofBench9%—
Omni-MATH—15.6%
LiveBench Math—13.6%

Knowledge Not comparable

GPT-5.1-Codex: —, OLMo 2 Furious 13B: 18.0 (#278)

Knowledge benchmarks
BenchmarkGPT-5.1-CodexOLMo 2 Furious 13B
MMLU-Pro—31%
GPQA (HELM)—31.6%

Instruction Following Not comparable

GPT-5.1-Codex: —, OLMo 2 Furious 13B: 61.1 (#243)

Instruction Following benchmarks
BenchmarkGPT-5.1-CodexOLMo 2 Furious 13B
LiveBench Instruction Following—60.6%
IFEval—73%

Writing & Preference Not comparable

GPT-5.1-Codex: —, OLMo 2 Furious 13B: 43.0 (#226)

Writing & Preference benchmarks
BenchmarkGPT-5.1-CodexOLMo 2 Furious 13B
WildBench—68.9%
LiveBench Language—11.2%

Frequently asked questions

Is GPT-5.1-Codex better than OLMo 2 Furious 13B?

GPT-5.1-Codex is the stronger model overall, scoring 38.2 to 29.2 on the Noometry Index.

Is GPT-5.1-Codex or OLMo 2 Furious 13B better for coding?

GPT-5.1-Codex scores higher on coding benchmarks: 41.7 versus 28.1 in the Noometry coding category.

How many benchmarks do GPT-5.1-Codex and OLMo 2 Furious 13B share?

0 benchmarks have published results for both models. GPT-5.1-Codex has 6 scored results on Noometry and OLMo 2 Furious 13B has 12.

Related comparisons

Go deeper