Model comparison

Grok 4.1 Fast vs Step 5 Preview

Step 5 Preview is the stronger model overall, scoring 47.9 to 41.4 on the Noometry Index. Grok 4.1 Fast costs 5.2× less per token, which makes it the better buy when Step 5 Preview's lead doesn't matter for your workload.

Last verified . 16 shared benchmarks.

Grok 4.1 Fast xAI

41.4

Rank #136 Confirmed

Step 5 Preview StepFun

47.9

Rank #58 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Grok 4.1 Fast scores higher in 1 category and Step 5 Preview in 8 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Step 5 Preview leads 51.8 to 34.1.
  • The biggest single-benchmark swing is ProofBench: 4% for Grok 4.1 Fast and 42% for Step 5 Preview.
  • Grok 4.1 Fast is cheaper at $0.20 / $0.50 per million input/output tokens, against $1 / $2.70 for Step 5 Preview.
  • Step 5 Preview accepts more context: 1.02M tokens versus 128K.

Side by side

Grok 4.1 Fast and Step 5 Preview specifications
Grok 4.1 FastStep 5 Preview
ProviderxAIStepFun
Noometry Index41.447.9
Released2025-06-272026-09-16
WeightsProprietaryProprietary
Context window128K1.02M
Max output30K66K
Input $ / M tokens$0.20$1
Output $ / M tokens$0.50$2.70
Results tracked3218

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 5 Preview leads

Grok 4.1 Fast: 34.1 (#245), Step 5 Preview: 51.8 (#36)

Coding benchmarks
BenchmarkGrok 4.1 FastStep 5 Preview
LMArena WebDev12421564
LMArena Coding14111480
SciCode—58.9%
ALE-Bench394.93—

Agentic & Tool Use Not comparable

Grok 4.1 Fast: 36.3 (#39), Step 5 Preview: —

Agentic & Tool Use benchmarks
BenchmarkGrok 4.1 FastStep 5 Preview
Berkeley Function Calling Leaderboard69.6%—
τ²-bench Banking13.1%—
LMArena Search1171—
Vending-Bench 21,107—

Reasoning Grok 4.1 Fast leads

Grok 4.1 Fast: 43.4 (#49), Step 5 Preview: 40.0 (#57)

Reasoning benchmarks
BenchmarkGrok 4.1 FastStep 5 Preview
LMArena Hard Prompts14071465
SimpleBench56%—
NYT Connections (extended)87.4%—
CritPt—20.9%
DTBench87.7%—
ForecastBench61—

Math Step 5 Preview leads

Grok 4.1 Fast: 31.9 (#221), Step 5 Preview: 46.1 (#72)

Math benchmarks
BenchmarkGrok 4.1 FastStep 5 Preview
ProofBench4%42%
LMArena Math14081470
MathArena Final-Answer Competitions60.9%—

Knowledge Step 5 Preview leads

Grok 4.1 Fast: 33.1 (#207), Step 5 Preview: 41.2 (#112)

Knowledge benchmarks
BenchmarkGrok 4.1 FastStep 5 Preview
LMArena Expert13991470
Vectara Hallucination Rate17.8%—

Multimodal Step 5 Preview leads

Grok 4.1 Fast: 37.0 (#76), Step 5 Preview: 41.0 (#41)

Multimodal benchmarks
BenchmarkGrok 4.1 FastStep 5 Preview
LMArena Vision12011267

Multilingual Step 5 Preview leads

Grok 4.1 Fast: 51.0 (#114), Step 5 Preview: 53.8 (#54)

Multilingual benchmarks
BenchmarkGrok 4.1 FastStep 5 Preview
LMArena Non-English13911432
LMArena Chinese14411519
LMArena Russian13871436
LMArena Spanish14131439
LMArena French1415—
LMArena German1404—
LMArena Japanese1349—
LMArena Korean1361—

Instruction Following Step 5 Preview leads

Grok 4.1 Fast: 72.7 (#133), Step 5 Preview: 76.0 (#50)

Instruction Following benchmarks
BenchmarkGrok 4.1 FastStep 5 Preview
LMArena Instruction Following13761444

Long Context Step 5 Preview leads

Grok 4.1 Fast: 42.4 (#126), Step 5 Preview: 44.5 (#64)

Long Context benchmarks
BenchmarkGrok 4.1 FastStep 5 Preview
LMArena Longer Query13901455

Writing & Preference Step 5 Preview leads

Grok 4.1 Fast: 57.2 (#131), Step 5 Preview: 62.8 (#71)

Writing & Preference benchmarks
BenchmarkGrok 4.1 FastStep 5 Preview
LMArena Text14081442
LMArena Creative Writing13941410
LMArena Multi-Turn13891447
EQ-Bench Creative Writing1327—

Frequently asked questions

Is Grok 4.1 Fast better than Step 5 Preview?

Step 5 Preview is the stronger model overall, scoring 47.9 to 41.4 on the Noometry Index. Grok 4.1 Fast costs 5.2× less per token, which makes it the better buy when Step 5 Preview's lead doesn't matter for your workload.

Which is cheaper, Grok 4.1 Fast or Step 5 Preview?

Grok 4.1 Fast is cheaper. It lists at $0.20 per million input tokens and $0.50 per million output tokens; Step 5 Preview lists at $1 and $2.70.

Is Grok 4.1 Fast or Step 5 Preview better for coding?

Step 5 Preview scores higher on coding benchmarks: 51.8 versus 34.1 in the Noometry coding category.

Which has the bigger context window?

Step 5 Preview does, with 1.02M tokens against 128K.

How many benchmarks do Grok 4.1 Fast and Step 5 Preview share?

16 benchmarks have published results for both models. Grok 4.1 Fast has 32 scored results on Noometry and Step 5 Preview has 18.

Related comparisons

Go deeper