Model comparison

Llama 3.1 Nemotron 70b Instruct vs Step 5 Preview

Step 5 Preview is the stronger model overall, scoring 43.8 to 37.0 on the Noometry Index.

Last verified . 0 shared benchmarks.

Step 5 Preview StepFun

43.8

Rank #78 Reported

Summary

  • The widest gap is in coding, where Step 5 Preview leads 50.6 to 35.3.
  • Llama 3.1 Nemotron 70b Instruct has downloadable open weights; the other is API-only.

Side by side

Llama 3.1 Nemotron 70b Instruct and Step 5 Preview specifications
Llama 3.1 Nemotron 70b InstructStep 5 Preview
ProviderNVIDIAStepFun
Noometry Index37.043.8
Released2024-12-182026-09-16
WeightsOpenProprietary
Context window—1.02M
Max output—66K
Input $ / M tokens—$1
Output $ / M tokens—$2.70
Results tracked143

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 5 Preview leads

Llama 3.1 Nemotron 70b Instruct: 35.3 (#212), Step 5 Preview: 50.6 (#40)

Coding benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructStep 5 Preview
LMArena WebDev—1569
SciCode—58.9%
BigCodeBench Instruct38.7%—
LMArena Coding1272—
BigCodeBench Complete48.2%—

Reasoning Step 5 Preview leads

Llama 3.1 Nemotron 70b Instruct: 24.0 (#156), Step 5 Preview: 38.0 (#58)

Reasoning benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructStep 5 Preview
CritPt—20.9%
LMArena Hard Prompts1266—

Math Not comparable

Llama 3.1 Nemotron 70b Instruct: 32.9 (#182), Step 5 Preview: —

Math benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructStep 5 Preview
LMArena Math1271—

Knowledge Not comparable

Llama 3.1 Nemotron 70b Instruct: 33.5 (#194), Step 5 Preview: —

Knowledge benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructStep 5 Preview
LMArena Expert1242—

Multilingual Not comparable

Llama 3.1 Nemotron 70b Instruct: 40.7 (#212), Step 5 Preview: —

Multilingual benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructStep 5 Preview
LMArena Non-English1245—
LMArena Chinese1263—
LMArena Russian1227—

Instruction Following Not comparable

Llama 3.1 Nemotron 70b Instruct: 66.2 (#208), Step 5 Preview: —

Instruction Following benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructStep 5 Preview
LMArena Instruction Following1252—

Long Context Not comparable

Llama 3.1 Nemotron 70b Instruct: 37.5 (#210), Step 5 Preview: —

Long Context benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructStep 5 Preview
LMArena Longer Query1239—

Writing & Preference Not comparable

Llama 3.1 Nemotron 70b Instruct: 48.6 (#197), Step 5 Preview: —

Writing & Preference benchmarks
BenchmarkLlama 3.1 Nemotron 70b InstructStep 5 Preview
LMArena Text1283—
LMArena Creative Writing1269—
LMArena Multi-Turn1275—

Frequently asked questions

Is Llama 3.1 Nemotron 70b Instruct better than Step 5 Preview?

Step 5 Preview is the stronger model overall, scoring 43.8 to 37.0 on the Noometry Index.

Is Llama 3.1 Nemotron 70b Instruct or Step 5 Preview better for coding?

Step 5 Preview scores higher on coding benchmarks: 50.6 versus 35.3 in the Noometry coding category.

How many benchmarks do Llama 3.1 Nemotron 70b Instruct and Step 5 Preview share?

0 benchmarks have published results for both models. Llama 3.1 Nemotron 70b Instruct has 14 scored results on Noometry and Step 5 Preview has 3.

Related comparisons

Go deeper