Model comparison

Llama 13b vs Step 5 Preview

Step 5 Preview is the stronger model overall, scoring 47.9 to 24.4 on the Noometry Index.

Last verified . 8 shared benchmarks.

Llama 13b Meta

24.4

Rank #348 Confirmed

Step 5 Preview StepFun

47.9

Rank #58 Confirmed

Summary

  • They share 8 benchmarks with published results for both. Llama 13b scores higher in 0 categories and Step 5 Preview in 6 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Step 5 Preview leads 62.8 to 13.8.
  • Llama 13b has downloadable open weights; the other is API-only.

Side by side

Llama 13b and Step 5 Preview specifications
Llama 13bStep 5 Preview
ProviderMetaStepFun
Noometry Index24.447.9
Released2023-02-242026-09-16
WeightsOpenProprietary
Context window—1.02M
Max output—66K
Input $ / M tokens—$1
Output $ / M tokens—$2.70
Results tracked2118

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 5 Preview leads

Llama 13b: 21.4 (#337), Step 5 Preview: 51.8 (#36)

Coding benchmarks
BenchmarkLlama 13bStep 5 Preview
LMArena Coding6831480
LMArena WebDev—1564
SciCode—58.9%

Reasoning Step 5 Preview leads

Llama 13b: 14.0 (#329), Step 5 Preview: 40.0 (#57)

Reasoning benchmarks
BenchmarkLlama 13bStep 5 Preview
LMArena Hard Prompts7281465
CritPt—20.9%
BIG-Bench Hard37.9%—
Epoch Capabilities Index100.58—
HellaSwag79.2%—
LAMBADA75.2%—
PIQA80.1%—
WinoGrande73%—

Math Step 5 Preview leads

Llama 13b: 26.7 (#256), Step 5 Preview: 46.1 (#72)

Math benchmarks
BenchmarkLlama 13bStep 5 Preview
LMArena Math8381470
ProofBench—42%
GSM8K20.6%—

Knowledge Not comparable

Llama 13b: —, Step 5 Preview: 41.2 (#112)

Knowledge benchmarks
BenchmarkLlama 13bStep 5 Preview
LMArena Expert—1470
ARC (AI2) Challenge52.7%—
BoolQ78.7%—
MMLU47.7%—
OpenBookQA56.4%—
TriviaQA77.9%—

Multimodal Not comparable

Llama 13b: —, Step 5 Preview: 41.0 (#41)

Multimodal benchmarks
BenchmarkLlama 13bStep 5 Preview
LMArena Vision—1267
ScienceQA43.3%—

Multilingual Step 5 Preview leads

Llama 13b: 16.6 (#297), Step 5 Preview: 53.8 (#54)

Multilingual benchmarks
BenchmarkLlama 13bStep 5 Preview
LMArena Non-English8191432
LMArena Chinese—1519
LMArena Russian—1436
LMArena Spanish—1439

Instruction Following Step 5 Preview leads

Llama 13b: 36.7 (#305), Step 5 Preview: 76.0 (#50)

Instruction Following benchmarks
BenchmarkLlama 13bStep 5 Preview
LMArena Instruction Following7811444

Long Context Not comparable

Llama 13b: —, Step 5 Preview: 44.5 (#64)

Long Context benchmarks
BenchmarkLlama 13bStep 5 Preview
LMArena Longer Query—1455

Writing & Preference Step 5 Preview leads

Llama 13b: 13.8 (#312), Step 5 Preview: 62.8 (#71)

Writing & Preference benchmarks
BenchmarkLlama 13bStep 5 Preview
LMArena Text8341442
LMArena Creative Writing7941410
LMArena Multi-Turn7531447

Frequently asked questions

Is Llama 13b better than Step 5 Preview?

Step 5 Preview is the stronger model overall, scoring 47.9 to 24.4 on the Noometry Index.

Is Llama 13b or Step 5 Preview better for coding?

Step 5 Preview scores higher on coding benchmarks: 51.8 versus 21.4 in the Noometry coding category.

How many benchmarks do Llama 13b and Step 5 Preview share?

8 benchmarks have published results for both models. Llama 13b has 21 scored results on Noometry and Step 5 Preview has 18.

Related comparisons

Go deeper