Model comparison

Mistral vs Step 1o Turbo 202506

Step 1o Turbo 202506 is the stronger model overall, scoring 39.7 to 29.9 on the Noometry Index.

Last verified . 13 shared benchmarks.

Mistral Mistral AI

29.9

Rank #303 Confirmed

Step 1o Turbo 202506 StepFun

39.7

Rank #160 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Mistral scores higher in 0 categories and Step 1o Turbo 202506 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Step 1o Turbo 202506 leads 36.1 to 16.6.

Side by side

Mistral and Step 1o Turbo 202506 specifications
MistralStep 1o Turbo 202506
ProviderMistral AIStepFun
Noometry Index29.939.7
Released——
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2214

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 1o Turbo 202506 leads

Mistral: 33.8 (#250), Step 1o Turbo 202506: 39.2 (#160)

Coding benchmarks
BenchmarkMistralStep 1o Turbo 202506
LMArena Coding11621339

Reasoning Step 1o Turbo 202506 leads

Mistral: 22.2 (#200), Step 1o Turbo 202506: 26.8 (#129)

Reasoning benchmarks
BenchmarkMistralStep 1o Turbo 202506
LMArena Hard Prompts11491335

Math Step 1o Turbo 202506 leads

Mistral: 22.3 (#278), Step 1o Turbo 202506: 36.6 (#164)

Math benchmarks
BenchmarkMistralStep 1o Turbo 202506
LMArena Math11801318
Omni-MATH7.2%—

Knowledge Step 1o Turbo 202506 leads

Mistral: 16.6 (#288), Step 1o Turbo 202506: 36.1 (#176)

Knowledge benchmarks
BenchmarkMistralStep 1o Turbo 202506
LMArena Expert11251308
MMLU-Pro27.7%—
GPQA (HELM)30.3%—

Multimodal Not comparable

Mistral: —, Step 1o Turbo 202506: 36.1 (#80)

Multimodal benchmarks
BenchmarkMistralStep 1o Turbo 202506
LMArena Vision—1186

Multilingual Step 1o Turbo 202506 leads

Mistral: 32.8 (#254), Step 1o Turbo 202506: 45.3 (#173)

Multilingual benchmarks
BenchmarkMistralStep 1o Turbo 202506
LMArena Non-English11291313
LMArena Chinese11091380
LMArena German11551314
LMArena Russian11681327
LMArena French1180—
LMArena Japanese1013—
LMArena Korean1032—
LMArena Spanish1143—

Instruction Following Step 1o Turbo 202506 leads

Mistral: 52.6 (#288), Step 1o Turbo 202506: 69.2 (#176)

Instruction Following benchmarks
BenchmarkMistralStep 1o Turbo 202506
LMArena Instruction Following11521310
IFEval56.8%—

Long Context Step 1o Turbo 202506 leads

Mistral: 35.0 (#245), Step 1o Turbo 202506: 41.0 (#146)

Long Context benchmarks
BenchmarkMistralStep 1o Turbo 202506
LMArena Longer Query11531348

Writing & Preference Step 1o Turbo 202506 leads

Mistral: 37.0 (#260), Step 1o Turbo 202506: 53.1 (#160)

Writing & Preference benchmarks
BenchmarkMistralStep 1o Turbo 202506
LMArena Text11651336
LMArena Creative Writing11581307
LMArena Multi-Turn11471340
WildBench66%—

Frequently asked questions

Is Mistral better than Step 1o Turbo 202506?

Step 1o Turbo 202506 is the stronger model overall, scoring 39.7 to 29.9 on the Noometry Index.

Is Mistral or Step 1o Turbo 202506 better for coding?

Step 1o Turbo 202506 scores higher on coding benchmarks: 39.2 versus 33.8 in the Noometry coding category.

How many benchmarks do Mistral and Step 1o Turbo 202506 share?

13 benchmarks have published results for both models. Mistral has 22 scored results on Noometry and Step 1o Turbo 202506 has 14.

Related comparisons

Go deeper