Model comparison

Mistral Nemo vs Step 3.7 Flash

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 26.4 on the Noometry Index. Mistral Nemo costs 2.8× less per token, which makes it the better buy when Step 3.7 Flash's lead doesn't matter for your workload.

Last verified . 0 shared benchmarks.

Mistral Nemo Mistral AI

26.4

Rank #337 Confirmed

Step 3.7 Flash StepFun

37.3

Rank #207 Reported

Summary

  • The widest gap is in math, where Step 3.7 Flash leads 42.9 to 25.5.
  • Mistral Nemo is cheaper at $0.15 / $0.15 per million input/output tokens, against $0.18 / $1.11 for Step 3.7 Flash.
  • Step 3.7 Flash accepts more context: 256K tokens versus 128K.

Side by side

Mistral Nemo and Step 3.7 Flash specifications
Mistral NemoStep 3.7 Flash
ProviderMistral AIStepFun
Noometry Index26.437.3
Released2024-07-012026-05-29
WeightsOpenOpen
Context window128K256K
Max output128K256K
Input $ / M tokens$0.15$0.18
Output $ / M tokens$0.15$1.11
Results tracked105

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Mistral Nemo: —, Step 3.7 Flash: 40.0 (#150)

Coding benchmarks
BenchmarkMistral NemoStep 3.7 Flash
SciCode—40%
ALE-Bench—694.12

Agentic & Tool Use Not comparable

Mistral Nemo: 23.5 (#125), Step 3.7 Flash: —

Agentic & Tool Use benchmarks
BenchmarkMistral NemoStep 3.7 Flash
Berkeley Function Calling Leaderboard27.6%—
BALROG17.6%—

Reasoning Too close to call

Mistral Nemo: 20.7 (#232), Step 3.7 Flash: 21.6 (#219)

Reasoning benchmarks
BenchmarkMistral NemoStep 3.7 Flash
NYT Connections (extended)—39.7%
CritPt—2.3%
DTBench48.6%—
Epoch Capabilities Index118.68—
PIQA83.5%—

Math Step 3.7 Flash leads

Mistral Nemo: 25.5 (#268), Step 3.7 Flash: 42.9 (#82)

Math benchmarks
BenchmarkMistral NemoStep 3.7 Flash
MathArena Final-Answer Competitions—68.5%
MATH Level 510.8%—
GSM8K84.2%—

Knowledge Not comparable

Mistral Nemo: 12.3 (#298), Step 3.7 Flash: —

Knowledge benchmarks
BenchmarkMistral NemoStep 3.7 Flash
GPQA Diamond29.9%—
BoolQ82.5%—

Writing & Preference Not comparable

Mistral Nemo: 28.5 (#296), Step 3.7 Flash: —

Writing & Preference benchmarks
BenchmarkMistral NemoStep 3.7 Flash
EQ-Bench Creative Writing881—

Frequently asked questions

Is Mistral Nemo better than Step 3.7 Flash?

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 26.4 on the Noometry Index. Mistral Nemo costs 2.8× less per token, which makes it the better buy when Step 3.7 Flash's lead doesn't matter for your workload.

Which is cheaper, Mistral Nemo or Step 3.7 Flash?

Mistral Nemo is cheaper. It lists at $0.15 per million input tokens and $0.15 per million output tokens; Step 3.7 Flash lists at $0.18 and $1.11.

Which has the bigger context window?

Step 3.7 Flash does, with 256K tokens against 128K.

How many benchmarks do Mistral Nemo and Step 3.7 Flash share?

0 benchmarks have published results for both models. Mistral Nemo has 10 scored results on Noometry and Step 3.7 Flash has 5.

Related comparisons

Go deeper