Noometry

Model comparison

Phi 3 Small 8k Instruct vs Step 1o Turbo 202506

Step 1o Turbo 202506 is the stronger model overall, scoring 39.7 to 29.3 on the Noometry Index.

Last verified . 13 shared benchmarks.

Phi 3 Small 8k Instruct Microsoft

29.3

Rank #314 Confirmed

Step 1o Turbo 202506 StepFun

39.7

Rank #160 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Phi 3 Small 8k Instruct scores higher in 0 categories and Step 1o Turbo 202506 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Step 1o Turbo 202506 leads 53.1 to 31.1.
  • Phi 3 Small 8k Instruct has downloadable open weights; the other is API-only.

Side by side

Phi 3 Small 8k InstructStep 1o Turbo 202506
ProviderMicrosoftStepFun
Noometry Index29.339.7
Released2024-04-23—
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked3214

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 1o Turbo 202506 leads

Phi 3 Small 8k Instruct: 27.9 (#318), Step 1o Turbo 202506: 39.2 (#160)

BenchmarkPhi 3 Small 8k InstructStep 1o Turbo 202506
LMArena Coding11011339
LiveBench Coding20.3%—

Reasoning Step 1o Turbo 202506 leads

Phi 3 Small 8k Instruct: 14.8 (#323), Step 1o Turbo 202506: 26.8 (#129)

BenchmarkPhi 3 Small 8k InstructStep 1o Turbo 202506
LMArena Hard Prompts11001335
LiveBench Reasoning15.9%—
LiveBench Data Analysis30.3%—
Adversarial NLI58.1%—
BIG-Bench Hard79.1%—
HellaSwag77%—
LiveBench24%—
WinoGrande81.5%—

Math Step 1o Turbo 202506 leads

Phi 3 Small 8k Instruct: 27.6 (#248), Step 1o Turbo 202506: 36.6 (#164)

BenchmarkPhi 3 Small 8k InstructStep 1o Turbo 202506
LMArena Math11511318
LiveBench Math17.6%—

Knowledge Step 1o Turbo 202506 leads

Phi 3 Small 8k Instruct: 29.1 (#240), Step 1o Turbo 202506: 36.1 (#176)

BenchmarkPhi 3 Small 8k InstructStep 1o Turbo 202506
LMArena Expert10671308
ARC (AI2) Challenge90.7%—
MMLU75.7%—
OpenBookQA88%—
TriviaQA58.1%—

Multimodal Not comparable

Phi 3 Small 8k Instruct: —, Step 1o Turbo 202506: 36.1 (#80)

BenchmarkPhi 3 Small 8k InstructStep 1o Turbo 202506
LMArena Vision—1186

Multilingual Step 1o Turbo 202506 leads

Phi 3 Small 8k Instruct: 28.5 (#272), Step 1o Turbo 202506: 45.3 (#173)

BenchmarkPhi 3 Small 8k InstructStep 1o Turbo 202506
LMArena Non-English10581313
LMArena Chinese10611380
LMArena German10801314
LMArena Russian11111327
LMArena French1135—
LMArena Japanese966—
LMArena Korean894—
LMArena Spanish1111—

Instruction Following Step 1o Turbo 202506 leads

Phi 3 Small 8k Instruct: 51.9 (#292), Step 1o Turbo 202506: 69.2 (#176)

BenchmarkPhi 3 Small 8k InstructStep 1o Turbo 202506
LMArena Instruction Following10871310
LiveBench Instruction Following47.2%—

Long Context Step 1o Turbo 202506 leads

Phi 3 Small 8k Instruct: 33.0 (#267), Step 1o Turbo 202506: 41.0 (#146)

BenchmarkPhi 3 Small 8k InstructStep 1o Turbo 202506
LMArena Longer Query10881348

Writing & Preference Step 1o Turbo 202506 leads

Phi 3 Small 8k Instruct: 31.1 (#284), Step 1o Turbo 202506: 53.1 (#160)

BenchmarkPhi 3 Small 8k InstructStep 1o Turbo 202506
LMArena Text11101336
LMArena Creative Writing10831307
LMArena Multi-Turn10681340
LiveBench Language12.9%—

Frequently asked questions

Is Phi 3 Small 8k Instruct better than Step 1o Turbo 202506?

Step 1o Turbo 202506 is the stronger model overall, scoring 39.7 to 29.3 on the Noometry Index.

Is Phi 3 Small 8k Instruct or Step 1o Turbo 202506 better for coding?

Step 1o Turbo 202506 scores higher on coding benchmarks: 39.2 versus 27.9 in the Noometry coding category.

How many benchmarks do Phi 3 Small 8k Instruct and Step 1o Turbo 202506 share?

13 benchmarks have published results for both models. Phi 3 Small 8k Instruct has 32 scored results on Noometry and Step 1o Turbo 202506 has 14.

Related comparisons

Go deeper