Noometry

Model comparison

Phi-4 vs Step 1o Turbo 202506

Step 1o Turbo 202506 is the stronger model overall, scoring 39.1 to 30.9 on the Noometry Index.

Last verified . 13 shared benchmarks.

Phi-4 Microsoft

30.9

Rank #269 Confirmed

Step 1o Turbo 202506 StepFun

39.1

Rank #160 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Phi-4 scores higher in 0 categories and Step 1o Turbo 202506 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Step 1o Turbo 202506 leads 33.9 to 19.6.
  • Phi-4 has downloadable open weights; the other is API-only.

Side by side

Phi-4Step 1o Turbo 202506
ProviderMicrosoftStepFun
Noometry Index30.939.1
Released2024-12-11—
WeightsOpenProprietary
Context window128K—
Max output4K—
Input $ / M tokens$0.07—
Output $ / M tokens$0.14—
Results tracked3714

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 1o Turbo 202506 leads

Phi-4: 33.8 (#237), Step 1o Turbo 202506: 38.6 (#158)

BenchmarkPhi-4Step 1o Turbo 202506
LMArena Coding12311339
BigCodeBench Instruct45.5%—
LiveBench Coding30.7%—
BigCodeBench Complete55.4%—

Agentic & Tool Use Not comparable

Phi-4: 22.6 (#120), Step 1o Turbo 202506: —

BenchmarkPhi-4Step 1o Turbo 202506
Berkeley Function Calling Leaderboard28.8%—
BALROG11.6%—

Reasoning Step 1o Turbo 202506 leads

Phi-4: 17.0 (#287), Step 1o Turbo 202506: 25.7 (#127)

BenchmarkPhi-4Step 1o Turbo 202506
LMArena Hard Prompts12201336
Chess Puzzles1%—
LiveBench Reasoning47.8%—
LiveBench Data Analysis45.2%—
Epoch Capabilities Index130.43—
LiveBench41.6%—

Math Step 1o Turbo 202506 leads

Phi-4: 19.6 (#279), Step 1o Turbo 202506: 33.9 (#163)

BenchmarkPhi-4Step 1o Turbo 202506
LMArena Math12461318
OTIS Mock AIME 2024-202513.8%—
LiveBench Math42%—
MATH Level 564.9%—

Knowledge Step 1o Turbo 202506 leads

Phi-4: 32.5 (#204), Step 1o Turbo 202506: 35.5 (#174)

BenchmarkPhi-4Step 1o Turbo 202506
LMArena Expert12031308
GPQA Diamond56.1%—
Confabulations29.4%—
Vectara Hallucination Rate3.7%—
MMLU84.8%—

Multimodal Not comparable

Phi-4: —, Step 1o Turbo 202506: 35.4 (#75)

BenchmarkPhi-4Step 1o Turbo 202506
LMArena Vision—1186

Multilingual Step 1o Turbo 202506 leads

Phi-4: 37.4 (#232), Step 1o Turbo 202506: 45.5 (#168)

BenchmarkPhi-4Step 1o Turbo 202506
LMArena Non-English11971313
LMArena Chinese12111380
LMArena German12221315
LMArena Russian12091327
LMArena French1223—
LMArena Japanese1158—
LMArena Korean1151—
LMArena Spanish1234—

Instruction Following Step 1o Turbo 202506 leads

Phi-4: 60.6 (#246), Step 1o Turbo 202506: 69.4 (#171)

BenchmarkPhi-4Step 1o Turbo 202506
LMArena Instruction Following12011311
LiveBench Instruction Following58.4%—

Long Context Step 1o Turbo 202506 leads

Phi-4: 36.9 (#221), Step 1o Turbo 202506: 41.1 (#141)

BenchmarkPhi-4Step 1o Turbo 202506
LMArena Longer Query12171350

Writing & Preference Step 1o Turbo 202506 leads

Phi-4: 40.7 (#239), Step 1o Turbo 202506: 53.4 (#154)

BenchmarkPhi-4Step 1o Turbo 202506
LMArena Text12171336
LMArena Creative Writing11821308
LMArena Multi-Turn12061341
Short-Story Creative Writing62.6%—
LiveBench Language25.6%—

Frequently asked questions

Is Phi-4 better than Step 1o Turbo 202506?

Step 1o Turbo 202506 is the stronger model overall, scoring 39.1 to 30.9 on the Noometry Index.

Is Phi-4 or Step 1o Turbo 202506 better for coding?

Step 1o Turbo 202506 scores higher on coding benchmarks: 38.6 versus 33.8 in the Noometry coding category.

How many benchmarks do Phi-4 and Step 1o Turbo 202506 share?

13 benchmarks have published results for both models. Phi-4 has 37 scored results on Noometry and Step 1o Turbo 202506 has 14.

Related comparisons

Go deeper