Model comparison

Phi 3 Mini 128k Instruct vs Step 5 Preview

Step 5 Preview is the stronger model overall, scoring 47.9 to 29.7 on the Noometry Index.

Last verified . 13 shared benchmarks.

Phi 3 Mini 128k Instruct Microsoft

29.7

Rank #305 Confirmed

Step 5 Preview StepFun

47.9

Rank #58 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Phi 3 Mini 128k Instruct scores higher in 0 categories and Step 5 Preview in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Step 5 Preview leads 62.8 to 27.1.
  • Phi 3 Mini 128k Instruct has downloadable open weights; the other is API-only.

Side by side

Phi 3 Mini 128k Instruct and Step 5 Preview specifications
Phi 3 Mini 128k InstructStep 5 Preview
ProviderMicrosoftStepFun
Noometry Index29.747.9
Released2024-04-232026-09-16
WeightsOpenProprietary
Context window—1.02M
Max output—66K
Input $ / M tokens—$1
Output $ / M tokens—$2.70
Results tracked1918

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 5 Preview leads

Phi 3 Mini 128k Instruct: 28.8 (#312), Step 5 Preview: 51.8 (#36)

Coding benchmarks
BenchmarkPhi 3 Mini 128k InstructStep 5 Preview
LMArena Coding10391480
LMArena WebDev—1564
SciCode—58.9%
BigCodeBench Instruct29.6%—
BigCodeBench Complete40.6%—

Reasoning Step 5 Preview leads

Phi 3 Mini 128k Instruct: 19.6 (#256), Step 5 Preview: 40.0 (#57)

Reasoning benchmarks
BenchmarkPhi 3 Mini 128k InstructStep 5 Preview
LMArena Hard Prompts10281465
CritPt—20.9%

Math Step 5 Preview leads

Phi 3 Mini 128k Instruct: 31.6 (#222), Step 5 Preview: 46.1 (#72)

Math benchmarks
BenchmarkPhi 3 Mini 128k InstructStep 5 Preview
LMArena Math10891470
ProofBench—42%

Knowledge Step 5 Preview leads

Phi 3 Mini 128k Instruct: 26.8 (#254), Step 5 Preview: 41.2 (#112)

Knowledge benchmarks
BenchmarkPhi 3 Mini 128k InstructStep 5 Preview
LMArena Expert9841470

Multimodal Not comparable

Phi 3 Mini 128k Instruct: —, Step 5 Preview: 41.0 (#41)

Multimodal benchmarks
BenchmarkPhi 3 Mini 128k InstructStep 5 Preview
LMArena Vision—1267

Multilingual Step 5 Preview leads

Phi 3 Mini 128k Instruct: 25.2 (#285), Step 5 Preview: 53.8 (#54)

Multilingual benchmarks
BenchmarkPhi 3 Mini 128k InstructStep 5 Preview
LMArena Non-English10001432
LMArena Chinese10161519
LMArena Russian10041436
LMArena Spanish10591439
LMArena French1039—
LMArena German1006—
LMArena Japanese899—
LMArena Korean856—

Instruction Following Step 5 Preview leads

Phi 3 Mini 128k Instruct: 51.8 (#294), Step 5 Preview: 76.0 (#50)

Instruction Following benchmarks
BenchmarkPhi 3 Mini 128k InstructStep 5 Preview
LMArena Instruction Following10231444

Long Context Step 5 Preview leads

Phi 3 Mini 128k Instruct: 30.4 (#289), Step 5 Preview: 44.5 (#64)

Long Context benchmarks
BenchmarkPhi 3 Mini 128k InstructStep 5 Preview
LMArena Longer Query9961455

Writing & Preference Step 5 Preview leads

Phi 3 Mini 128k Instruct: 27.1 (#301), Step 5 Preview: 62.8 (#71)

Writing & Preference benchmarks
BenchmarkPhi 3 Mini 128k InstructStep 5 Preview
LMArena Text10501442
LMArena Creative Writing10241410
LMArena Multi-Turn9891447

Frequently asked questions

Is Phi 3 Mini 128k Instruct better than Step 5 Preview?

Step 5 Preview is the stronger model overall, scoring 47.9 to 29.7 on the Noometry Index.

Is Phi 3 Mini 128k Instruct or Step 5 Preview better for coding?

Step 5 Preview scores higher on coding benchmarks: 51.8 versus 28.8 in the Noometry coding category.

How many benchmarks do Phi 3 Mini 128k Instruct and Step 5 Preview share?

13 benchmarks have published results for both models. Phi 3 Mini 128k Instruct has 19 scored results on Noometry and Step 5 Preview has 18.

Related comparisons

Go deeper