Model comparison

OLMo 2 Furious 13B vs Solar Pro4

Solar Pro4 is the stronger model overall, scoring 41.5 to 29.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Solar Pro4 Upstage

41.5

Rank #123 Confirmed

Summary

  • The widest gap is in knowledge, where Solar Pro4 leads 39.0 to 18.0.
  • OLMo 2 Furious 13B has downloadable open weights; the other is API-only.

Side by side

OLMo 2 Furious 13B and Solar Pro4 specifications
OLMo 2 Furious 13BSolar Pro4
ProviderAllen Institute for AI (Ai2)Upstage
Noometry Index29.241.5
Released2024-12-312026-08-06
WeightsOpenProprietary
Context window—524K
Max output—131K
Input $ / M tokens—$0.30
Output $ / M tokens—$1.20
Results tracked1218

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Solar Pro4 leads

OLMo 2 Furious 13B: 28.1 (#309), Solar Pro4: 39.9 (#135)

Coding benchmarks
BenchmarkOLMo 2 Furious 13BSolar Pro4
LMArena WebDev—1371
LiveBench Coding10.4%—
LMArena Coding—1439

Reasoning Solar Pro4 leads

OLMo 2 Furious 13B: 14.8 (#312), Solar Pro4: 27.3 (#107)

Reasoning benchmarks
BenchmarkOLMo 2 Furious 13BSolar Pro4
LiveBench Reasoning16.3%—
LMArena Hard Prompts—1398
LiveBench Data Analysis20.6%—
LiveBench22.1%—

Math Solar Pro4 leads

OLMo 2 Furious 13B: 21.3 (#270), Solar Pro4: 36.1 (#129)

Math benchmarks
BenchmarkOLMo 2 Furious 13BSolar Pro4
Omni-MATH15.6%—
LiveBench Math13.6%—
LMArena Math—1418

Knowledge Solar Pro4 leads

OLMo 2 Furious 13B: 18.0 (#278), Solar Pro4: 39.0 (#128)

Knowledge benchmarks
BenchmarkOLMo 2 Furious 13BSolar Pro4
MMLU-Pro31%—
GPQA (HELM)31.6%—
LMArena Expert—1421

Multilingual Not comparable

OLMo 2 Furious 13B: —, Solar Pro4: 49.0 (#134)

Multilingual benchmarks
BenchmarkOLMo 2 Furious 13BSolar Pro4
LMArena Non-English—1362
LMArena Chinese—1417
LMArena French—1403
LMArena German—1351
LMArena Japanese—1300
LMArena Korean—1383
LMArena Russian—1360
LMArena Spanish—1408

Instruction Following Solar Pro4 leads

OLMo 2 Furious 13B: 61.1 (#243), Solar Pro4: 72.8 (#128)

Instruction Following benchmarks
BenchmarkOLMo 2 Furious 13BSolar Pro4
LiveBench Instruction Following60.6%—
IFEval73%—
LMArena Instruction Following—1376

Long Context Not comparable

OLMo 2 Furious 13B: —, Solar Pro4: 42.0 (#125)

Long Context benchmarks
BenchmarkOLMo 2 Furious 13BSolar Pro4
LMArena Longer Query—1379

Writing & Preference Solar Pro4 leads

OLMo 2 Furious 13B: 43.0 (#226), Solar Pro4: 56.7 (#133)

Writing & Preference benchmarks
BenchmarkOLMo 2 Furious 13BSolar Pro4
LMArena Text—1386
LMArena Creative Writing—1313
WildBench68.9%—
LMArena Multi-Turn—1391
LiveBench Language11.2%—

Frequently asked questions

Is OLMo 2 Furious 13B better than Solar Pro4?

Solar Pro4 is the stronger model overall, scoring 41.5 to 29.2 on the Noometry Index.

Is OLMo 2 Furious 13B or Solar Pro4 better for coding?

Solar Pro4 scores higher on coding benchmarks: 39.9 versus 28.1 in the Noometry coding category.

How many benchmarks do OLMo 2 Furious 13B and Solar Pro4 share?

0 benchmarks have published results for both models. OLMo 2 Furious 13B has 12 scored results on Noometry and Solar Pro4 has 18.

Related comparisons

Go deeper