Model comparison

Mistral Small vs Step 5 Preview

Step 5 Preview is the stronger model overall, scoring 43.8 to 33.1 on the Noometry Index. Mistral Small costs 5.4× less per token, which makes it the better buy when Step 5 Preview's lead doesn't matter for your workload.

Last verified . 2 shared benchmarks.

Mistral Small Mistral AI

33.1

Rank #238 Confirmed

Step 5 Preview StepFun

43.8

Rank #78 Reported

Summary

  • They share 2 benchmarks with published results for both. Mistral Small scores higher in 0 categories and Step 5 Preview in 2 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Step 5 Preview leads 38.0 to 19.3.
  • The biggest single-benchmark swing is SciCode: 26.5% for Mistral Small and 58.9% for Step 5 Preview.
  • Mistral Small is cheaper at $0.15 / $0.60 per million input/output tokens, against $1 / $2.70 for Step 5 Preview.
  • Step 5 Preview accepts more context: 1.02M tokens versus 256K.
  • Mistral Small has downloadable open weights; the other is API-only.

Side by side

Mistral Small and Step 5 Preview specifications
Mistral SmallStep 5 Preview
ProviderMistral AIStepFun
Noometry Index33.143.8
Released2024-02-262026-09-16
WeightsOpenProprietary
Context window256K1.02M
Max output256K66K
Input $ / M tokens$0.15$1
Output $ / M tokens$0.60$2.70
Results tracked393

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 5 Preview leads

Mistral Small: 33.5 (#242), Step 5 Preview: 50.6 (#40)

Coding benchmarks
BenchmarkMistral SmallStep 5 Preview
SciCode26.5%58.9%
LMArena WebDev—1569
BigCodeBench Instruct36.1%—
LiveBench Coding36.2%—
LMArena Coding1363—
BigCodeBench Complete46.6%—
ALE-Bench497.62—

Agentic & Tool Use Not comparable

Mistral Small: 27.9 (#87), Step 5 Preview: —

Agentic & Tool Use benchmarks
BenchmarkMistral SmallStep 5 Preview
Berkeley Function Calling Leaderboard37.1%—

Reasoning Step 5 Preview leads

Mistral Small: 19.3 (#238), Step 5 Preview: 38.0 (#58)

Reasoning benchmarks
BenchmarkMistral SmallStep 5 Preview
CritPt0%20.9%
Kagi LLM Benchmark37.8%—
LiveBench Reasoning44.8%—
LMArena Hard Prompts1336—
DTBench70.9%—
LiveBench Data Analysis53.7%—
LMCA20.6%—
LiveBench44%—

Math Not comparable

Mistral Small: 15.4 (#287), Step 5 Preview: —

Math benchmarks
BenchmarkMistral SmallStep 5 Preview
OTIS Mock AIME 2024-20255.8%—
LiveBench Math39.9%—
LMArena Math1341—
MATH Level 546.8%—

Knowledge Not comparable

Mistral Small: 30.9 (#214), Step 5 Preview: —

Knowledge benchmarks
BenchmarkMistral SmallStep 5 Preview
GPQA Diamond47.5%—
Vectara Hallucination Rate5.1%—
LMArena Expert1293—
MMLU68.7%—

Multimodal Not comparable

Mistral Small: 32.9 (#91), Step 5 Preview: —

Multimodal benchmarks
BenchmarkMistral SmallStep 5 Preview
LMArena Vision1142—

Multilingual Not comparable

Mistral Small: 45.7 (#164), Step 5 Preview: —

Multilingual benchmarks
BenchmarkMistral SmallStep 5 Preview
LMArena Non-English1315—
LMArena Chinese1342—
LMArena French1337—
LMArena German1341—
LMArena Japanese1275—
LMArena Korean1260—
LMArena Russian1324—
LMArena Spanish1346—

Instruction Following Not comparable

Mistral Small: 66.6 (#204), Step 5 Preview: —

Instruction Following benchmarks
BenchmarkMistral SmallStep 5 Preview
LiveBench Instruction Following63.7%—
LMArena Instruction Following1310—

Long Context Not comparable

Mistral Small: 40.4 (#151), Step 5 Preview: —

Long Context benchmarks
BenchmarkMistral SmallStep 5 Preview
LMArena Longer Query1327—

Writing & Preference Not comparable

Mistral Small: 52.6 (#165), Step 5 Preview: —

Writing & Preference benchmarks
BenchmarkMistral SmallStep 5 Preview
LMArena Text1338—
LMArena Creative Writing1304—
LMArena Multi-Turn1344—
LiveBench Language30.5%—

Frequently asked questions

Is Mistral Small better than Step 5 Preview?

Step 5 Preview is the stronger model overall, scoring 43.8 to 33.1 on the Noometry Index. Mistral Small costs 5.4× less per token, which makes it the better buy when Step 5 Preview's lead doesn't matter for your workload.

Which is cheaper, Mistral Small or Step 5 Preview?

Mistral Small is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; Step 5 Preview lists at $1 and $2.70.

Is Mistral Small or Step 5 Preview better for coding?

Step 5 Preview scores higher on coding benchmarks: 50.6 versus 33.5 in the Noometry coding category.

Which has the bigger context window?

Step 5 Preview does, with 1.02M tokens against 256K.

How many benchmarks do Mistral Small and Step 5 Preview share?

2 benchmarks have published results for both models. Mistral Small has 39 scored results on Noometry and Step 5 Preview has 3.

Related comparisons

Go deeper