Model comparison

Nemotron 4 340b Instruct vs Step 3.7 Flash

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 35.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Nemotron 4 340b Instruct NVIDIA

35.9

Rank #223 Confirmed

Step 3.7 Flash StepFun

37.3

Rank #207 Reported

Summary

  • The widest gap is in math, where Step 3.7 Flash leads 42.9 to 34.3.

Side by side

Nemotron 4 340b Instruct and Step 3.7 Flash specifications
Nemotron 4 340b InstructStep 3.7 Flash
ProviderNVIDIAStepFun
Noometry Index35.937.3
Released2024-06-142026-05-29
WeightsOpenOpen
Context window—256K
Max output—256K
Input $ / M tokens—$0.18
Output $ / M tokens—$1.11
Results tracked175

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.7 Flash leads

Nemotron 4 340b Instruct: 35.2 (#228), Step 3.7 Flash: 40.0 (#150)

Coding benchmarks
BenchmarkNemotron 4 340b InstructStep 3.7 Flash
SciCode—40%
LMArena Coding1209—
ALE-Bench—694.12

Reasoning Nemotron 4 340b Instruct leads

Nemotron 4 340b Instruct: 23.4 (#178), Step 3.7 Flash: 21.6 (#219)

Reasoning benchmarks
BenchmarkNemotron 4 340b InstructStep 3.7 Flash
NYT Connections (extended)—39.7%
CritPt—2.3%
LMArena Hard Prompts1202—

Math Step 3.7 Flash leads

Nemotron 4 340b Instruct: 34.3 (#195), Step 3.7 Flash: 42.9 (#82)

Math benchmarks
BenchmarkNemotron 4 340b InstructStep 3.7 Flash
MathArena Final-Answer Competitions—68.5%
LMArena Math1216—

Knowledge Not comparable

Nemotron 4 340b Instruct: 32.0 (#216), Step 3.7 Flash: —

Knowledge benchmarks
BenchmarkNemotron 4 340b InstructStep 3.7 Flash
LMArena Expert1171—

Multilingual Not comparable

Nemotron 4 340b Instruct: 37.9 (#233), Step 3.7 Flash: —

Multilingual benchmarks
BenchmarkNemotron 4 340b InstructStep 3.7 Flash
LMArena Non-English1206—
LMArena Chinese1214—
LMArena French1197—
LMArena German1192—
LMArena Japanese1128—
LMArena Korean1148—
LMArena Russian1219—
LMArena Spanish1195—

Instruction Following Not comparable

Nemotron 4 340b Instruct: 63.1 (#232), Step 3.7 Flash: —

Instruction Following benchmarks
BenchmarkNemotron 4 340b InstructStep 3.7 Flash
LMArena Instruction Following1203—

Long Context Not comparable

Nemotron 4 340b Instruct: 37.1 (#221), Step 3.7 Flash: —

Long Context benchmarks
BenchmarkNemotron 4 340b InstructStep 3.7 Flash
LMArena Longer Query1225—

Writing & Preference Not comparable

Nemotron 4 340b Instruct: 42.7 (#233), Step 3.7 Flash: —

Writing & Preference benchmarks
BenchmarkNemotron 4 340b InstructStep 3.7 Flash
LMArena Text1225—
LMArena Creative Writing1203—
LMArena Multi-Turn1214—

Frequently asked questions

Is Nemotron 4 340b Instruct better than Step 3.7 Flash?

Step 3.7 Flash is the stronger model overall, scoring 37.3 to 35.9 on the Noometry Index.

Is Nemotron 4 340b Instruct or Step 3.7 Flash better for coding?

Step 3.7 Flash scores higher on coding benchmarks: 40.0 versus 35.2 in the Noometry coding category.

How many benchmarks do Nemotron 4 340b Instruct and Step 3.7 Flash share?

0 benchmarks have published results for both models. Nemotron 4 340b Instruct has 17 scored results on Noometry and Step 3.7 Flash has 5.

Related comparisons

Go deeper