Model comparison

Phi-1.5 vs Step 1o Turbo 202506

Step 1o Turbo 202506 has enough public results to be ranked (#160); Phi-1.5 does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Phi-1.5 Microsoft

—

Unranked

Step 1o Turbo 202506 StepFun

39.7

Rank #160 Confirmed

Summary

  • Phi-1.5 has downloadable open weights; the other is API-only.

Side by side

Phi-1.5 and Step 1o Turbo 202506 specifications
Phi-1.5Step 1o Turbo 202506
ProviderMicrosoftStepFun
Noometry Index—39.7
Released2023-09-11—
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked714

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Phi-1.5: —, Step 1o Turbo 202506: 39.2 (#160)

Coding benchmarks
BenchmarkPhi-1.5Step 1o Turbo 202506
LMArena Coding—1339

Reasoning Not comparable

Phi-1.5: —, Step 1o Turbo 202506: 26.8 (#129)

Reasoning benchmarks
BenchmarkPhi-1.5Step 1o Turbo 202506
LMArena Hard Prompts—1335
Epoch Capabilities Index91.53—
HellaSwag47.6%—
WinoGrande73.4%—

Math Not comparable

Phi-1.5: —, Step 1o Turbo 202506: 36.6 (#164)

Math benchmarks
BenchmarkPhi-1.5Step 1o Turbo 202506
LMArena Math—1318

Knowledge Not comparable

Phi-1.5: —, Step 1o Turbo 202506: 36.1 (#176)

Knowledge benchmarks
BenchmarkPhi-1.5Step 1o Turbo 202506
LMArena Expert—1308
ARC (AI2) Challenge44.4%—
BoolQ75.8%—
MMLU37.6%—
OpenBookQA37.2%—

Multimodal Not comparable

Phi-1.5: —, Step 1o Turbo 202506: 36.1 (#80)

Multimodal benchmarks
BenchmarkPhi-1.5Step 1o Turbo 202506
LMArena Vision—1186

Multilingual Not comparable

Phi-1.5: —, Step 1o Turbo 202506: 45.3 (#173)

Multilingual benchmarks
BenchmarkPhi-1.5Step 1o Turbo 202506
LMArena Non-English—1313
LMArena Chinese—1380
LMArena German—1314
LMArena Russian—1327

Instruction Following Not comparable

Phi-1.5: —, Step 1o Turbo 202506: 69.2 (#176)

Instruction Following benchmarks
BenchmarkPhi-1.5Step 1o Turbo 202506
LMArena Instruction Following—1310

Long Context Not comparable

Phi-1.5: —, Step 1o Turbo 202506: 41.0 (#146)

Long Context benchmarks
BenchmarkPhi-1.5Step 1o Turbo 202506
LMArena Longer Query—1348

Writing & Preference Not comparable

Phi-1.5: —, Step 1o Turbo 202506: 53.1 (#160)

Writing & Preference benchmarks
BenchmarkPhi-1.5Step 1o Turbo 202506
LMArena Text—1336
LMArena Creative Writing—1307
LMArena Multi-Turn—1340

Frequently asked questions

Is Phi-1.5 better than Step 1o Turbo 202506?

Step 1o Turbo 202506 has enough public results to be ranked (#160); Phi-1.5 does not yet, so treat this comparison as directional.

How many benchmarks do Phi-1.5 and Step 1o Turbo 202506 share?

0 benchmarks have published results for both models. Phi-1.5 has 7 scored results on Noometry and Step 1o Turbo 202506 has 14.

Related comparisons

Go deeper