Model comparison

o3-pro vs OLMo 2 Furious 13B

o3-pro is the stronger model overall, scoring 42.9 to 29.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

o3-pro OpenAI

42.9

Rank #105 Confirmed

Summary

  • The widest gap is in coding, where o3-pro leads 55.5 to 28.6.
  • OLMo 2 Furious 13B has downloadable open weights; the other is API-only.

Side by side

o3-pro and OLMo 2 Furious 13B specifications
o3-proOLMo 2 Furious 13B
ProviderOpenAIAllen Institute for AI (Ai2)
Noometry Index42.929.7
Released2025-06-102024-12-31
WeightsProprietaryOpen
Context window200K—
Max output100K—
Input $ / M tokens$20—
Output $ / M tokens$80—
Results tracked1212

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding o3-pro leads

o3-pro: 55.5 (#24), OLMo 2 Furious 13B: 28.6 (#313)

Coding benchmarks
Benchmarko3-proOLMo 2 Furious 13B
Aider Polyglot84.9%—
WeirdML58.2%—
LiveBench Coding—10.4%

Reasoning o3-pro leads

o3-pro: 23.8 (#171), OLMo 2 Furious 13B: 15.5 (#314)

Reasoning benchmarks
Benchmarko3-proOLMo 2 Furious 13B
ARC-AGI-24.9%—
Kagi LLM Benchmark72.1%—
ARC-AGI-159.3%—
LiveBench Reasoning—16.3%
DTBench86.9%—
LiveBench Data Analysis—20.6%
LMCA38.5%—
Epoch Capabilities Index147.42—
LiveBench—22.1%

Math Not comparable

o3-pro: —, OLMo 2 Furious 13B: 23.1 (#273)

Math benchmarks
Benchmarko3-proOLMo 2 Furious 13B
Omni-MATH—15.6%
LiveBench Math—13.6%

Knowledge o3-pro leads

o3-pro: 29.5 (#238), OLMo 2 Furious 13B: 18.3 (#283)

Knowledge benchmarks
Benchmarko3-proOLMo 2 Furious 13B
MMLU-Pro—31%
Confabulations14.2%—
Vectara Hallucination Rate23.3%—
GPQA (HELM)—31.6%

Instruction Following Not comparable

o3-pro: —, OLMo 2 Furious 13B: 60.9 (#248)

Instruction Following benchmarks
Benchmarko3-proOLMo 2 Furious 13B
LiveBench Instruction Following—60.6%
IFEval—73%

Long Context Not comparable

o3-pro: 72.2 (#1), OLMo 2 Furious 13B: —

Long Context benchmarks
Benchmarko3-proOLMo 2 Furious 13B
Fiction.LiveBench97.2%—

Writing & Preference o3-pro leads

o3-pro: 57.1 (#133), OLMo 2 Furious 13B: 42.9 (#230)

Writing & Preference benchmarks
Benchmarko3-proOLMo 2 Furious 13B
Short-Story Creative Writing84.4%—
WildBench—68.9%
LiveBench Language—11.2%

Frequently asked questions

Is o3-pro better than OLMo 2 Furious 13B?

o3-pro is the stronger model overall, scoring 42.9 to 29.7 on the Noometry Index.

Is o3-pro or OLMo 2 Furious 13B better for coding?

o3-pro scores higher on coding benchmarks: 55.5 versus 28.6 in the Noometry coding category.

How many benchmarks do o3-pro and OLMo 2 Furious 13B share?

0 benchmarks have published results for both models. o3-pro has 12 scored results on Noometry and OLMo 2 Furious 13B has 12.

Related comparisons

Go deeper