Model comparison

Phi 3 Mini 128k Instruct vs Step 1o Turbo 202506

Step 1o Turbo 202506 is the stronger model overall, scoring 39.7 to 29.7 on the Noometry Index.

Last verified . 13 shared benchmarks.

Phi 3 Mini 128k Instruct Microsoft

29.7

Rank #305 Confirmed

Step 1o Turbo 202506 StepFun

39.7

Rank #160 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Phi 3 Mini 128k Instruct scores higher in 0 categories and Step 1o Turbo 202506 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Step 1o Turbo 202506 leads 53.1 to 27.1.
  • Phi 3 Mini 128k Instruct has downloadable open weights; the other is API-only.

Side by side

Phi 3 Mini 128k Instruct and Step 1o Turbo 202506 specifications
Phi 3 Mini 128k InstructStep 1o Turbo 202506
ProviderMicrosoftStepFun
Noometry Index29.739.7
Released2024-04-23—
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1914

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 1o Turbo 202506 leads

Phi 3 Mini 128k Instruct: 28.8 (#312), Step 1o Turbo 202506: 39.2 (#160)

Coding benchmarks
BenchmarkPhi 3 Mini 128k InstructStep 1o Turbo 202506
LMArena Coding10391339
BigCodeBench Instruct29.6%—
BigCodeBench Complete40.6%—

Reasoning Step 1o Turbo 202506 leads

Phi 3 Mini 128k Instruct: 19.6 (#256), Step 1o Turbo 202506: 26.8 (#129)

Reasoning benchmarks
BenchmarkPhi 3 Mini 128k InstructStep 1o Turbo 202506
LMArena Hard Prompts10281335

Math Step 1o Turbo 202506 leads

Phi 3 Mini 128k Instruct: 31.6 (#222), Step 1o Turbo 202506: 36.6 (#164)

Math benchmarks
BenchmarkPhi 3 Mini 128k InstructStep 1o Turbo 202506
LMArena Math10891318

Knowledge Step 1o Turbo 202506 leads

Phi 3 Mini 128k Instruct: 26.8 (#254), Step 1o Turbo 202506: 36.1 (#176)

Knowledge benchmarks
BenchmarkPhi 3 Mini 128k InstructStep 1o Turbo 202506
LMArena Expert9841308

Multimodal Not comparable

Phi 3 Mini 128k Instruct: —, Step 1o Turbo 202506: 36.1 (#80)

Multimodal benchmarks
BenchmarkPhi 3 Mini 128k InstructStep 1o Turbo 202506
LMArena Vision—1186

Multilingual Step 1o Turbo 202506 leads

Phi 3 Mini 128k Instruct: 25.2 (#285), Step 1o Turbo 202506: 45.3 (#173)

Multilingual benchmarks
BenchmarkPhi 3 Mini 128k InstructStep 1o Turbo 202506
LMArena Non-English10001313
LMArena Chinese10161380
LMArena German10061314
LMArena Russian10041327
LMArena French1039—
LMArena Japanese899—
LMArena Korean856—
LMArena Spanish1059—

Instruction Following Step 1o Turbo 202506 leads

Phi 3 Mini 128k Instruct: 51.8 (#294), Step 1o Turbo 202506: 69.2 (#176)

Instruction Following benchmarks
BenchmarkPhi 3 Mini 128k InstructStep 1o Turbo 202506
LMArena Instruction Following10231310

Long Context Step 1o Turbo 202506 leads

Phi 3 Mini 128k Instruct: 30.4 (#289), Step 1o Turbo 202506: 41.0 (#146)

Long Context benchmarks
BenchmarkPhi 3 Mini 128k InstructStep 1o Turbo 202506
LMArena Longer Query9961348

Writing & Preference Step 1o Turbo 202506 leads

Phi 3 Mini 128k Instruct: 27.1 (#301), Step 1o Turbo 202506: 53.1 (#160)

Writing & Preference benchmarks
BenchmarkPhi 3 Mini 128k InstructStep 1o Turbo 202506
LMArena Text10501336
LMArena Creative Writing10241307
LMArena Multi-Turn9891340

Frequently asked questions

Is Phi 3 Mini 128k Instruct better than Step 1o Turbo 202506?

Step 1o Turbo 202506 is the stronger model overall, scoring 39.7 to 29.7 on the Noometry Index.

Is Phi 3 Mini 128k Instruct or Step 1o Turbo 202506 better for coding?

Step 1o Turbo 202506 scores higher on coding benchmarks: 39.2 versus 28.8 in the Noometry coding category.

How many benchmarks do Phi 3 Mini 128k Instruct and Step 1o Turbo 202506 share?

13 benchmarks have published results for both models. Phi 3 Mini 128k Instruct has 19 scored results on Noometry and Step 1o Turbo 202506 has 14.

Related comparisons

Go deeper