Model comparison

OLMo 2 Furious 13B vs Wizardlm 70b

Wizardlm 70b is the stronger model overall, scoring 33.0 to 29.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

Wizardlm 70b Microsoft

33.0

Rank #249 Confirmed

Summary

  • The widest gap is in math, where Wizardlm 70b leads 32.2 to 23.1.

Side by side

OLMo 2 Furious 13B and Wizardlm 70b specifications
OLMo 2 Furious 13BWizardlm 70b
ProviderAllen Institute for AI (Ai2)Microsoft
Noometry Index29.733.0
Released2024-12-31—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1212

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Wizardlm 70b leads

OLMo 2 Furious 13B: 28.6 (#313), Wizardlm 70b: 31.4 (#285)

Coding benchmarks
BenchmarkOLMo 2 Furious 13BWizardlm 70b
LiveBench Coding10.4%—
LMArena Coding—1081

Reasoning Wizardlm 70b leads

OLMo 2 Furious 13B: 15.5 (#314), Wizardlm 70b: 20.7 (#234)

Reasoning benchmarks
BenchmarkOLMo 2 Furious 13BWizardlm 70b
LiveBench Reasoning16.3%—
LMArena Hard Prompts—1079
LiveBench Data Analysis20.6%—
LiveBench22.1%—

Math Wizardlm 70b leads

OLMo 2 Furious 13B: 23.1 (#273), Wizardlm 70b: 32.2 (#218)

Math benchmarks
BenchmarkOLMo 2 Furious 13BWizardlm 70b
Omni-MATH15.6%—
LiveBench Math13.6%—
LMArena Math—1116

Knowledge Not comparable

OLMo 2 Furious 13B: 18.3 (#283), Wizardlm 70b: —

Knowledge benchmarks
BenchmarkOLMo 2 Furious 13BWizardlm 70b
MMLU-Pro31%—
GPQA (HELM)31.6%—

Multilingual Not comparable

OLMo 2 Furious 13B: —, Wizardlm 70b: 29.6 (#265)

Multilingual benchmarks
BenchmarkOLMo 2 Furious 13BWizardlm 70b
LMArena Non-English—1078
LMArena Chinese—1052
LMArena German—1083
LMArena Russian—1155

Instruction Following OLMo 2 Furious 13B leads

OLMo 2 Furious 13B: 60.9 (#248), Wizardlm 70b: 56.3 (#273)

Instruction Following benchmarks
BenchmarkOLMo 2 Furious 13BWizardlm 70b
LiveBench Instruction Following60.6%—
IFEval73%—
LMArena Instruction Following—1093

Long Context Not comparable

OLMo 2 Furious 13B: —, Wizardlm 70b: 33.3 (#263)

Long Context benchmarks
BenchmarkOLMo 2 Furious 13BWizardlm 70b
LMArena Longer Query—1097

Writing & Preference OLMo 2 Furious 13B leads

OLMo 2 Furious 13B: 42.9 (#230), Wizardlm 70b: 34.8 (#269)

Writing & Preference benchmarks
BenchmarkOLMo 2 Furious 13BWizardlm 70b
LMArena Text—1120
LMArena Creative Writing—1149
WildBench68.9%—
LMArena Multi-Turn—1108
LiveBench Language11.2%—

Frequently asked questions

Is OLMo 2 Furious 13B better than Wizardlm 70b?

Wizardlm 70b is the stronger model overall, scoring 33.0 to 29.7 on the Noometry Index.

Is OLMo 2 Furious 13B or Wizardlm 70b better for coding?

Wizardlm 70b scores higher on coding benchmarks: 31.4 versus 28.6 in the Noometry coding category.

How many benchmarks do OLMo 2 Furious 13B and Wizardlm 70b share?

0 benchmarks have published results for both models. OLMo 2 Furious 13B has 12 scored results on Noometry and Wizardlm 70b has 12.

Related comparisons

Go deeper