Model comparison

OLMo 2 Furious 13B vs Wizardlm 13b

Wizardlm 13b is the stronger model overall, scoring 30.8 to 29.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Wizardlm 13b Microsoft

30.8

Rank #272 Confirmed

Summary

  • The widest gap is in writing & preference, where OLMo 2 Furious 13B leads 43.0 to 30.7.

Side by side

OLMo 2 Furious 13B and Wizardlm 13b specifications
OLMo 2 Furious 13BWizardlm 13b
ProviderAllen Institute for AI (Ai2)Microsoft
Noometry Index29.230.8
Released2024-12-31—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1210

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Wizardlm 13b leads

OLMo 2 Furious 13B: 28.1 (#309), Wizardlm 13b: 29.6 (#293)

Coding benchmarks
BenchmarkOLMo 2 Furious 13BWizardlm 13b
LiveBench Coding10.4%—
LMArena Coding—1035

Reasoning Wizardlm 13b leads

OLMo 2 Furious 13B: 14.8 (#312), Wizardlm 13b: 18.5 (#265)

Reasoning benchmarks
BenchmarkOLMo 2 Furious 13BWizardlm 13b
LiveBench Reasoning16.3%—
LMArena Hard Prompts—1018
LiveBench Data Analysis20.6%—
LiveBench22.1%—

Math Wizardlm 13b leads

OLMo 2 Furious 13B: 21.3 (#270), Wizardlm 13b: 27.8 (#235)

Math benchmarks
BenchmarkOLMo 2 Furious 13BWizardlm 13b
Omni-MATH15.6%—
LiveBench Math13.6%—
LMArena Math—1017

Knowledge Not comparable

OLMo 2 Furious 13B: 18.0 (#278), Wizardlm 13b: —

Knowledge benchmarks
BenchmarkOLMo 2 Furious 13BWizardlm 13b
MMLU-Pro31%—
GPQA (HELM)31.6%—

Multilingual Not comparable

OLMo 2 Furious 13B: —, Wizardlm 13b: 27.3 (#272)

Multilingual benchmarks
BenchmarkOLMo 2 Furious 13BWizardlm 13b
LMArena Non-English—1034
LMArena Chinese—1023

Instruction Following OLMo 2 Furious 13B leads

OLMo 2 Furious 13B: 61.1 (#243), Wizardlm 13b: 53.7 (#280)

Instruction Following benchmarks
BenchmarkOLMo 2 Furious 13BWizardlm 13b
LiveBench Instruction Following60.6%—
IFEval73%—
LMArena Instruction Following—1049

Long Context Not comparable

OLMo 2 Furious 13B: —, Wizardlm 13b: 32.0 (#268)

Long Context benchmarks
BenchmarkOLMo 2 Furious 13BWizardlm 13b
LMArena Longer Query—1054

Writing & Preference OLMo 2 Furious 13B leads

OLMo 2 Furious 13B: 43.0 (#226), Wizardlm 13b: 30.7 (#282)

Writing & Preference benchmarks
BenchmarkOLMo 2 Furious 13BWizardlm 13b
LMArena Text—1077
LMArena Creative Writing—1090
WildBench68.9%—
LMArena Multi-Turn—1047
LiveBench Language11.2%—

Frequently asked questions

Is OLMo 2 Furious 13B better than Wizardlm 13b?

Wizardlm 13b is the stronger model overall, scoring 30.8 to 29.2 on the Noometry Index.

Is OLMo 2 Furious 13B or Wizardlm 13b better for coding?

Wizardlm 13b scores higher on coding benchmarks: 29.6 versus 28.1 in the Noometry coding category.

How many benchmarks do OLMo 2 Furious 13B and Wizardlm 13b share?

0 benchmarks have published results for both models. OLMo 2 Furious 13B has 12 scored results on Noometry and Wizardlm 13b has 10.

Related comparisons

Go deeper