Model comparison

Ministral 3B vs Step 3.5 Flash

Step 3.5 Flash is the stronger model overall, scoring 42.3 to 26.2 on the Noometry Index. Ministral 3B costs 1.5× less per token, which makes it the better buy when Step 3.5 Flash's lead doesn't matter for your workload.

Last verified . 0 shared benchmarks.

Ministral 3B Mistral AI

26.2

Rank #338 Confirmed

Step 3.5 Flash StepFun

42.3

Rank #116 Confirmed

Summary

  • The widest gap is in knowledge, where Step 3.5 Flash leads 39.6 to 10.4.
  • Ministral 3B is cheaper at $0.10 / $0.10 per million input/output tokens, against $0.10 / $0.30 for Step 3.5 Flash.
  • Step 3.5 Flash accepts more context: 256K tokens versus 131K.

Side by side

Ministral 3B and Step 3.5 Flash specifications
Ministral 3BStep 3.5 Flash
ProviderMistral AIStepFun
Noometry Index26.242.3
Released2024-10-012026-01-29
WeightsOpenOpen
Context window131K256K
Max output262K256K
Input $ / M tokens$0.10$0.10
Output $ / M tokens$0.10$0.30
Results tracked619

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Ministral 3B: —, Step 3.5 Flash: 42.4 (#105)

Coding benchmarks
BenchmarkMinistral 3BStep 3.5 Flash
LMArena Coding—1436

Reasoning Step 3.5 Flash leads

Ministral 3B: 18.4 (#282), Step 3.5 Flash: 22.2 (#202)

Reasoning benchmarks
BenchmarkMinistral 3BStep 3.5 Flash
NYT Connections (extended)—28.4%
LMArena Hard Prompts—1411
DTBench51.7%—
LMCA5.5%—
Epoch Capabilities Index118.1—

Math Step 3.5 Flash leads

Ministral 3B: 26.6 (#258), Step 3.5 Flash: 42.6 (#84)

Math benchmarks
BenchmarkMinistral 3BStep 3.5 Flash
MathArena Final-Answer Competitions—66.8%
LMArena Math—1408
MATH Level 514.4%—

Knowledge Step 3.5 Flash leads

Ministral 3B: 10.4 (#302), Step 3.5 Flash: 39.6 (#132)

Knowledge benchmarks
BenchmarkMinistral 3BStep 3.5 Flash
GPQA Diamond25.3%—
Vectara Hallucination Rate7.3%—
LMArena Expert—1421

Multilingual Not comparable

Ministral 3B: —, Step 3.5 Flash: 50.5 (#119)

Multilingual benchmarks
BenchmarkMinistral 3BStep 3.5 Flash
LMArena Non-English—1385
LMArena Chinese—1447
LMArena French—1421
LMArena German—1405
LMArena Japanese—1354
LMArena Korean—1352
LMArena Russian—1385
LMArena Spanish—1419

Instruction Following Not comparable

Ministral 3B: —, Step 3.5 Flash: 73.1 (#124)

Instruction Following benchmarks
BenchmarkMinistral 3BStep 3.5 Flash
LMArena Instruction Following—1385

Long Context Not comparable

Ministral 3B: —, Step 3.5 Flash: 42.8 (#117)

Long Context benchmarks
BenchmarkMinistral 3BStep 3.5 Flash
LMArena Longer Query—1402

Writing & Preference Not comparable

Ministral 3B: —, Step 3.5 Flash: 58.8 (#113)

Writing & Preference benchmarks
BenchmarkMinistral 3BStep 3.5 Flash
LMArena Text—1403
LMArena Creative Writing—1357
LMArena Multi-Turn—1405

Frequently asked questions

Is Ministral 3B better than Step 3.5 Flash?

Step 3.5 Flash is the stronger model overall, scoring 42.3 to 26.2 on the Noometry Index. Ministral 3B costs 1.5× less per token, which makes it the better buy when Step 3.5 Flash's lead doesn't matter for your workload.

Which is cheaper, Ministral 3B or Step 3.5 Flash?

Ministral 3B is cheaper. It lists at $0.10 per million input tokens and $0.10 per million output tokens; Step 3.5 Flash lists at $0.10 and $0.30.

Which has the bigger context window?

Step 3.5 Flash does, with 256K tokens against 131K.

How many benchmarks do Ministral 3B and Step 3.5 Flash share?

0 benchmarks have published results for both models. Ministral 3B has 6 scored results on Noometry and Step 3.5 Flash has 19.

Related comparisons

Go deeper