Model comparison

OLMo 2 Furious 13B vs Phi-4 Mini

Phi-4 Mini is the stronger model overall, scoring 30.4 to 29.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Phi-4 Mini Microsoft

30.4

Rank #280 Reported

Summary

  • The widest gap is in reasoning, where Phi-4 Mini leads 21.7 to 14.8.

Side by side

OLMo 2 Furious 13B and Phi-4 Mini specifications
OLMo 2 Furious 13BPhi-4 Mini
ProviderAllen Institute for AI (Ai2)Microsoft
Noometry Index29.230.4
Released2024-12-312024-12-11
WeightsOpenOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.075
Output $ / M tokens—$0.30
Results tracked123

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

OLMo 2 Furious 13B: 28.1 (#309), Phi-4 Mini: 27.6 (#312)

Coding benchmarks
BenchmarkOLMo 2 Furious 13BPhi-4 Mini
SciCode—10.8%
LiveBench Coding10.4%—

Reasoning Phi-4 Mini leads

OLMo 2 Furious 13B: 14.8 (#312), Phi-4 Mini: 21.7 (#190)

Reasoning benchmarks
BenchmarkOLMo 2 Furious 13BPhi-4 Mini
CritPt—0%
LiveBench Reasoning16.3%—
LiveBench Data Analysis20.6%—
LiveBench22.1%—

Math Not comparable

OLMo 2 Furious 13B: 21.3 (#270), Phi-4 Mini: —

Math benchmarks
BenchmarkOLMo 2 Furious 13BPhi-4 Mini
Omni-MATH15.6%—
LiveBench Math13.6%—

Knowledge Phi-4 Mini leads

OLMo 2 Furious 13B: 18.0 (#278), Phi-4 Mini: 24.8 (#261)

Knowledge benchmarks
BenchmarkOLMo 2 Furious 13BPhi-4 Mini
MMLU-Pro31%—
Vectara Hallucination Rate—23.5%
GPQA (HELM)31.6%—

Instruction Following Not comparable

OLMo 2 Furious 13B: 61.1 (#243), Phi-4 Mini: —

Instruction Following benchmarks
BenchmarkOLMo 2 Furious 13BPhi-4 Mini
LiveBench Instruction Following60.6%—
IFEval73%—

Writing & Preference Not comparable

OLMo 2 Furious 13B: 43.0 (#226), Phi-4 Mini: —

Writing & Preference benchmarks
BenchmarkOLMo 2 Furious 13BPhi-4 Mini
WildBench68.9%—
LiveBench Language11.2%—

Frequently asked questions

Is OLMo 2 Furious 13B better than Phi-4 Mini?

Phi-4 Mini is the stronger model overall, scoring 30.4 to 29.2 on the Noometry Index.

Is OLMo 2 Furious 13B or Phi-4 Mini better for coding?

They score almost the same on coding (28.1 vs 27.6); test both on your own repository before choosing.

How many benchmarks do OLMo 2 Furious 13B and Phi-4 Mini share?

0 benchmarks have published results for both models. OLMo 2 Furious 13B has 12 scored results on Noometry and Phi-4 Mini has 3.

Related comparisons

Go deeper