Model comparison

Step 2 16k Exp 202412 vs Wizardlm 70b

Step 2 16k Exp 202412 is the stronger model overall, scoring 38.6 to 32.4 on the Noometry Index.

Last verified . 11 shared benchmarks.

Step 2 16k Exp 202412 StepFun

38.6

Rank #173 Confirmed

Wizardlm 70b Microsoft

32.4

Rank #245 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Step 2 16k Exp 202412 scores higher in 7 categories and Wizardlm 70b in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Step 2 16k Exp 202412 leads 52.5 to 34.9.
  • Wizardlm 70b has downloadable open weights; the other is API-only.

Side by side

Step 2 16k Exp 202412 and Wizardlm 70b specifications
Step 2 16k Exp 202412Wizardlm 70b
ProviderStepFunMicrosoft
Noometry Index38.632.4
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1212

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 2 16k Exp 202412 leads

Step 2 16k Exp 202412: 37.9 (#170), Wizardlm 70b: 30.9 (#280)

Coding benchmarks
BenchmarkStep 2 16k Exp 202412Wizardlm 70b
LMArena Coding13161081

Reasoning Step 2 16k Exp 202412 leads

Step 2 16k Exp 202412: 24.8 (#140), Wizardlm 70b: 19.8 (#231)

Reasoning benchmarks
BenchmarkStep 2 16k Exp 202412Wizardlm 70b
LMArena Hard Prompts12991079

Math Step 2 16k Exp 202412 leads

Step 2 16k Exp 202412: 33.6 (#171), Wizardlm 70b: 29.7 (#216)

Math benchmarks
BenchmarkStep 2 16k Exp 202412Wizardlm 70b
LMArena Math13051116

Knowledge Not comparable

Step 2 16k Exp 202412: 34.6 (#187), Wizardlm 70b: —

Knowledge benchmarks
BenchmarkStep 2 16k Exp 202412Wizardlm 70b
LMArena Expert1279—

Multilingual Step 2 16k Exp 202412 leads

Step 2 16k Exp 202412: 43.9 (#176), Wizardlm 70b: 29.8 (#260)

Multilingual benchmarks
BenchmarkStep 2 16k Exp 202412Wizardlm 70b
LMArena Non-English12901078
LMArena Chinese13311052
LMArena Russian13241155
LMArena German—1083

Instruction Following Step 2 16k Exp 202412 leads

Step 2 16k Exp 202412: 68.1 (#187), Wizardlm 70b: 56.5 (#268)

Instruction Following benchmarks
BenchmarkStep 2 16k Exp 202412Wizardlm 70b
LMArena Instruction Following12871093

Long Context Step 2 16k Exp 202412 leads

Step 2 16k Exp 202412: 39.7 (#165), Wizardlm 70b: 33.3 (#258)

Long Context benchmarks
BenchmarkStep 2 16k Exp 202412Wizardlm 70b
LMArena Longer Query13071097

Writing & Preference Step 2 16k Exp 202412 leads

Step 2 16k Exp 202412: 52.5 (#168), Wizardlm 70b: 34.9 (#264)

Writing & Preference benchmarks
BenchmarkStep 2 16k Exp 202412Wizardlm 70b
LMArena Text13211120
LMArena Creative Writing13281149
LMArena Multi-Turn12921108

Frequently asked questions

Is Step 2 16k Exp 202412 better than Wizardlm 70b?

Step 2 16k Exp 202412 is the stronger model overall, scoring 38.6 to 32.4 on the Noometry Index.

Is Step 2 16k Exp 202412 or Wizardlm 70b better for coding?

Step 2 16k Exp 202412 scores higher on coding benchmarks: 37.9 versus 30.9 in the Noometry coding category.

How many benchmarks do Step 2 16k Exp 202412 and Wizardlm 70b share?

11 benchmarks have published results for both models. Step 2 16k Exp 202412 has 12 scored results on Noometry and Wizardlm 70b has 12.

Related comparisons

Go deeper