Model comparison
Mistral Nemo vs Step 3.5 Flash
Step 3.5 Flash is the stronger model overall, scoring 42.3 to 26.4 on the Noometry Index.
Last verified . 0 shared benchmarks.
Mistral AI
StepFunSummary
- The widest gap is in writing & preference, where Step 3.5 Flash leads 58.8 to 28.5.
- Both cost about the same: $0.15 input and $0.15 output per million tokens.
- Step 3.5 Flash accepts more context: 256K tokens versus 128K.
Side by side
| Mistral Nemo | Step 3.5 Flash | |
|---|---|---|
| Provider | Mistral AI | StepFun |
| Noometry Index | 26.4 | 42.3 |
| Released | 2024-07-01 | 2026-01-29 |
| Weights | Open | Open |
| Context window | 128K | 256K |
| Max output | 128K | 256K |
| Input $ / M tokens | $0.15 | $0.10 |
| Output $ / M tokens | $0.15 | $0.30 |
| Results tracked | 10 | 19 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Not comparable
Mistral Nemo: —, Step 3.5 Flash: 42.4 (#105)
| Benchmark | Mistral Nemo | Step 3.5 Flash |
|---|---|---|
| LMArena Coding | — | 1436 |
Agentic & Tool Use Not comparable
Mistral Nemo: 23.5 (#125), Step 3.5 Flash: —
| Benchmark | Mistral Nemo | Step 3.5 Flash |
|---|---|---|
| Berkeley Function Calling Leaderboard | 27.6% | — |
| BALROG | 17.6% | — |
Reasoning Step 3.5 Flash leads
Mistral Nemo: 20.7 (#232), Step 3.5 Flash: 22.2 (#202)
| Benchmark | Mistral Nemo | Step 3.5 Flash |
|---|---|---|
| NYT Connections (extended) | — | 28.4% |
| LMArena Hard Prompts | — | 1411 |
| DTBench | 48.6% | — |
| Epoch Capabilities Index | 118.68 | — |
| PIQA | 83.5% | — |
Math Step 3.5 Flash leads
Mistral Nemo: 25.5 (#268), Step 3.5 Flash: 42.6 (#84)
| Benchmark | Mistral Nemo | Step 3.5 Flash |
|---|---|---|
| MathArena Final-Answer Competitions | — | 66.8% |
| LMArena Math | — | 1408 |
| MATH Level 5 | 10.8% | — |
| GSM8K | 84.2% | — |
Knowledge Step 3.5 Flash leads
Mistral Nemo: 12.3 (#298), Step 3.5 Flash: 39.6 (#132)
| Benchmark | Mistral Nemo | Step 3.5 Flash |
|---|---|---|
| GPQA Diamond | 29.9% | — |
| LMArena Expert | — | 1421 |
| BoolQ | 82.5% | — |
Multilingual Not comparable
Mistral Nemo: —, Step 3.5 Flash: 50.5 (#119)
| Benchmark | Mistral Nemo | Step 3.5 Flash |
|---|---|---|
| LMArena Non-English | — | 1385 |
| LMArena Chinese | — | 1447 |
| LMArena French | — | 1421 |
| LMArena German | — | 1405 |
| LMArena Japanese | — | 1354 |
| LMArena Korean | — | 1352 |
| LMArena Russian | — | 1385 |
| LMArena Spanish | — | 1419 |
Instruction Following Not comparable
Mistral Nemo: —, Step 3.5 Flash: 73.1 (#124)
| Benchmark | Mistral Nemo | Step 3.5 Flash |
|---|---|---|
| LMArena Instruction Following | — | 1385 |
Long Context Not comparable
Mistral Nemo: —, Step 3.5 Flash: 42.8 (#117)
| Benchmark | Mistral Nemo | Step 3.5 Flash |
|---|---|---|
| LMArena Longer Query | — | 1402 |
Writing & Preference Step 3.5 Flash leads
Mistral Nemo: 28.5 (#296), Step 3.5 Flash: 58.8 (#113)
| Benchmark | Mistral Nemo | Step 3.5 Flash |
|---|---|---|
| LMArena Text | — | 1403 |
| LMArena Creative Writing | — | 1357 |
| EQ-Bench Creative Writing | 881 | — |
| LMArena Multi-Turn | — | 1405 |
Frequently asked questions
Is Mistral Nemo better than Step 3.5 Flash?
Step 3.5 Flash is the stronger model overall, scoring 42.3 to 26.4 on the Noometry Index.
Which is cheaper, Mistral Nemo or Step 3.5 Flash?
Mistral Nemo is cheaper. It lists at $0.15 per million input tokens and $0.15 per million output tokens; Step 3.5 Flash lists at $0.10 and $0.30.
Which has the bigger context window?
Step 3.5 Flash does, with 256K tokens against 128K.
How many benchmarks do Mistral Nemo and Step 3.5 Flash share?
0 benchmarks have published results for both models. Mistral Nemo has 10 scored results on Noometry and Step 3.5 Flash has 19.