Model comparison

Step 2 16k Exp 202412 vs Wizardlm 13b

Step 2 16k Exp 202412 is the stronger model overall, scoring 39.2 to 31.4 on the Noometry Index.

Last verified . 10 shared benchmarks.

Step 2 16k Exp 202412 StepFun

39.2

Rank #171 Confirmed

Wizardlm 13b Microsoft

31.4

Rank #274 Confirmed

Summary

  • They share 10 benchmarks with published results for both. Step 2 16k Exp 202412 scores higher in 7 categories and Wizardlm 13b in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Step 2 16k Exp 202412 leads 52.3 to 30.5.
  • Wizardlm 13b has downloadable open weights; the other is API-only.

Side by side

Step 2 16k Exp 202412 and Wizardlm 13b specifications
Step 2 16k Exp 202412Wizardlm 13b
ProviderStepFunMicrosoft
Noometry Index39.231.4
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1210

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 2 16k Exp 202412 leads

Step 2 16k Exp 202412: 38.5 (#174), Wizardlm 13b: 30.1 (#298)

Coding benchmarks
BenchmarkStep 2 16k Exp 202412Wizardlm 13b
LMArena Coding13161035

Reasoning Step 2 16k Exp 202412 leads

Step 2 16k Exp 202412: 25.9 (#142), Wizardlm 13b: 19.4 (#259)

Reasoning benchmarks
BenchmarkStep 2 16k Exp 202412Wizardlm 13b
LMArena Hard Prompts12991018

Math Step 2 16k Exp 202412 leads

Step 2 16k Exp 202412: 36.3 (#169), Wizardlm 13b: 30.2 (#238)

Math benchmarks
BenchmarkStep 2 16k Exp 202412Wizardlm 13b
LMArena Math13041017

Knowledge Not comparable

Step 2 16k Exp 202412: 35.2 (#187), Wizardlm 13b: —

Knowledge benchmarks
BenchmarkStep 2 16k Exp 202412Wizardlm 13b
LMArena Expert1279—

Multilingual Step 2 16k Exp 202412 leads

Step 2 16k Exp 202412: 43.7 (#181), Wizardlm 13b: 27.1 (#277)

Multilingual benchmarks
BenchmarkStep 2 16k Exp 202412Wizardlm 13b
LMArena Non-English12901034
LMArena Chinese13311023
LMArena Russian1324—

Instruction Following Step 2 16k Exp 202412 leads

Step 2 16k Exp 202412: 67.9 (#192), Wizardlm 13b: 53.5 (#285)

Instruction Following benchmarks
BenchmarkStep 2 16k Exp 202412Wizardlm 13b
LMArena Instruction Following12871048

Long Context Step 2 16k Exp 202412 leads

Step 2 16k Exp 202412: 39.7 (#170), Wizardlm 13b: 32.0 (#273)

Long Context benchmarks
BenchmarkStep 2 16k Exp 202412Wizardlm 13b
LMArena Longer Query13071054

Writing & Preference Step 2 16k Exp 202412 leads

Step 2 16k Exp 202412: 52.3 (#173), Wizardlm 13b: 30.5 (#287)

Writing & Preference benchmarks
BenchmarkStep 2 16k Exp 202412Wizardlm 13b
LMArena Text13211077
LMArena Creative Writing13281091
LMArena Multi-Turn12921047

Frequently asked questions

Is Step 2 16k Exp 202412 better than Wizardlm 13b?

Step 2 16k Exp 202412 is the stronger model overall, scoring 39.2 to 31.4 on the Noometry Index.

Is Step 2 16k Exp 202412 or Wizardlm 13b better for coding?

Step 2 16k Exp 202412 scores higher on coding benchmarks: 38.5 versus 30.1 in the Noometry coding category.

How many benchmarks do Step 2 16k Exp 202412 and Wizardlm 13b share?

10 benchmarks have published results for both models. Step 2 16k Exp 202412 has 12 scored results on Noometry and Wizardlm 13b has 10.

Related comparisons

Go deeper