Model comparison

Chatgpt 4o Latest 20250326 vs OLMo 2 Furious 13B

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.2 to 29.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Summary

  • The widest gap is in knowledge, where Chatgpt 4o Latest 20250326 leads 38.7 to 18.0.
  • OLMo 2 Furious 13B has downloadable open weights; the other is API-only.

Side by side

Chatgpt 4o Latest 20250326 and OLMo 2 Furious 13B specifications
Chatgpt 4o Latest 20250326OLMo 2 Furious 13B
ProviderOpenAIAllen Institute for AI (Ai2)
Noometry Index43.229.2
Released—2024-12-31
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2112

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 41.0 (#122), OLMo 2 Furious 13B: 28.1 (#309)

Coding benchmarks
BenchmarkChatgpt 4o Latest 20250326OLMo 2 Furious 13B
LiveBench Coding—10.4%
LMArena Coding1413—

Reasoning Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 32.8 (#64), OLMo 2 Furious 13B: 14.8 (#312)

Reasoning benchmarks
BenchmarkChatgpt 4o Latest 20250326OLMo 2 Furious 13B
Kagi LLM Benchmark75%—
LiveBench Reasoning—16.3%
LMArena Hard Prompts1424—
LiveBench Data Analysis—20.6%
LiveBench—22.1%

Math Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 35.8 (#134), OLMo 2 Furious 13B: 21.3 (#270)

Math benchmarks
BenchmarkChatgpt 4o Latest 20250326OLMo 2 Furious 13B
Omni-MATH—15.6%
LiveBench Math—13.6%
LMArena Math1407—

Knowledge Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 38.7 (#131), OLMo 2 Furious 13B: 18.0 (#278)

Knowledge benchmarks
BenchmarkChatgpt 4o Latest 20250326OLMo 2 Furious 13B
MMLU-Pro—31%
Confabulations16.6%—
GPQA (HELM)—31.6%
LMArena Expert1400—

Multimodal Not comparable

Chatgpt 4o Latest 20250326: 38.9 (#54), OLMo 2 Furious 13B: —

Multimodal benchmarks
BenchmarkChatgpt 4o Latest 20250326OLMo 2 Furious 13B
LMArena Vision1243—

Multilingual Not comparable

Chatgpt 4o Latest 20250326: 53.1 (#72), OLMo 2 Furious 13B: —

Multilingual benchmarks
BenchmarkChatgpt 4o Latest 20250326OLMo 2 Furious 13B
LMArena Non-English1419—
LMArena Chinese1456—
LMArena French1447—
LMArena German1424—
LMArena Japanese1406—
LMArena Korean1397—
LMArena Russian1429—
LMArena Spanish1435—

Instruction Following Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 74.2 (#102), OLMo 2 Furious 13B: 61.1 (#243)

Instruction Following benchmarks
BenchmarkChatgpt 4o Latest 20250326OLMo 2 Furious 13B
LiveBench Instruction Following—60.6%
IFEval—73%
LMArena Instruction Following1403—

Long Context Not comparable

Chatgpt 4o Latest 20250326: 43.1 (#104), OLMo 2 Furious 13B: —

Long Context benchmarks
BenchmarkChatgpt 4o Latest 20250326OLMo 2 Furious 13B
LMArena Longer Query1413—

Writing & Preference Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 62.8 (#68), OLMo 2 Furious 13B: 43.0 (#226)

Writing & Preference benchmarks
BenchmarkChatgpt 4o Latest 20250326OLMo 2 Furious 13B
LMArena Text1429—
LMArena Creative Writing1406—
EQ-Bench Creative Writing1501—
WildBench—68.9%
LMArena Multi-Turn1454—
LiveBench Language—11.2%

Frequently asked questions

Is Chatgpt 4o Latest 20250326 better than OLMo 2 Furious 13B?

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.2 to 29.2 on the Noometry Index.

Is Chatgpt 4o Latest 20250326 or OLMo 2 Furious 13B better for coding?

Chatgpt 4o Latest 20250326 scores higher on coding benchmarks: 41.0 versus 28.1 in the Noometry coding category.

How many benchmarks do Chatgpt 4o Latest 20250326 and OLMo 2 Furious 13B share?

0 benchmarks have published results for both models. Chatgpt 4o Latest 20250326 has 21 scored results on Noometry and OLMo 2 Furious 13B has 12.

Related comparisons

Go deeper