Model comparison

Phi-3.5-mini vs Step 1o Turbo 202506

Step 1o Turbo 202506 has enough public results to be ranked (#160); Phi-3.5-mini does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Phi-3.5-mini Microsoft

36.9

Unranked Sparse

Step 1o Turbo 202506 StepFun

39.7

Rank #160 Confirmed

Summary

  • The widest gap is in coding, where Step 1o Turbo 202506 leads 39.2 to 34.6.
  • Phi-3.5-mini has downloadable open weights; the other is API-only.

Side by side

Phi-3.5-mini and Step 1o Turbo 202506 specifications
Phi-3.5-miniStep 1o Turbo 202506
ProviderMicrosoftStepFun
Noometry Index36.939.7
Released2024-08-16—
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked514

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 1o Turbo 202506 leads

Phi-3.5-mini: 34.6 (#232), Step 1o Turbo 202506: 39.2 (#160)

Coding benchmarks
BenchmarkPhi-3.5-miniStep 1o Turbo 202506
BigCodeBench Instruct32.8%—
LMArena Coding—1339
BigCodeBench Complete38.5%—

Reasoning Not comparable

Phi-3.5-mini: —, Step 1o Turbo 202506: 26.8 (#129)

Reasoning benchmarks
BenchmarkPhi-3.5-miniStep 1o Turbo 202506
LMArena Hard Prompts—1335
PIQA81%—

Math Not comparable

Phi-3.5-mini: —, Step 1o Turbo 202506: 36.6 (#164)

Math benchmarks
BenchmarkPhi-3.5-miniStep 1o Turbo 202506
LMArena Math—1318
GSM8K86.2%—

Knowledge Not comparable

Phi-3.5-mini: —, Step 1o Turbo 202506: 36.1 (#176)

Knowledge benchmarks
BenchmarkPhi-3.5-miniStep 1o Turbo 202506
LMArena Expert—1308
BoolQ78%—

Multimodal Not comparable

Phi-3.5-mini: —, Step 1o Turbo 202506: 36.1 (#80)

Multimodal benchmarks
BenchmarkPhi-3.5-miniStep 1o Turbo 202506
LMArena Vision—1186

Multilingual Not comparable

Phi-3.5-mini: —, Step 1o Turbo 202506: 45.3 (#173)

Multilingual benchmarks
BenchmarkPhi-3.5-miniStep 1o Turbo 202506
LMArena Non-English—1313
LMArena Chinese—1380
LMArena German—1314
LMArena Russian—1327

Instruction Following Not comparable

Phi-3.5-mini: —, Step 1o Turbo 202506: 69.2 (#176)

Instruction Following benchmarks
BenchmarkPhi-3.5-miniStep 1o Turbo 202506
LMArena Instruction Following—1310

Long Context Not comparable

Phi-3.5-mini: —, Step 1o Turbo 202506: 41.0 (#146)

Long Context benchmarks
BenchmarkPhi-3.5-miniStep 1o Turbo 202506
LMArena Longer Query—1348

Writing & Preference Not comparable

Phi-3.5-mini: —, Step 1o Turbo 202506: 53.1 (#160)

Writing & Preference benchmarks
BenchmarkPhi-3.5-miniStep 1o Turbo 202506
LMArena Text—1336
LMArena Creative Writing—1307
LMArena Multi-Turn—1340

Frequently asked questions

Is Phi-3.5-mini better than Step 1o Turbo 202506?

Step 1o Turbo 202506 has enough public results to be ranked (#160); Phi-3.5-mini does not yet, so treat this comparison as directional.

Is Phi-3.5-mini or Step 1o Turbo 202506 better for coding?

Step 1o Turbo 202506 scores higher on coding benchmarks: 39.2 versus 34.6 in the Noometry coding category.

How many benchmarks do Phi-3.5-mini and Step 1o Turbo 202506 share?

0 benchmarks have published results for both models. Phi-3.5-mini has 5 scored results on Noometry and Step 1o Turbo 202506 has 14.

Related comparisons

Go deeper