Model comparison

Llama 3.2 1B vs Step 5 Preview

Step 5 Preview is the stronger model overall, scoring 47.9 to 20.1 on the Noometry Index. Llama 3.2 1B costs 20× less per token, which makes it the better buy when Step 5 Preview's lead doesn't matter for your workload.

Last verified . 12 shared benchmarks.

Llama 3.2 1B Meta

20.1

Rank #354 Confirmed

Step 5 Preview StepFun

47.9

Rank #58 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Llama 3.2 1B scores higher in 0 categories and Step 5 Preview in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Step 5 Preview leads 62.8 to 21.3.
  • Llama 3.2 1B is cheaper at $0.027 / $0.20 per million input/output tokens, against $1 / $2.70 for Step 5 Preview.
  • Step 5 Preview accepts more context: 1.02M tokens versus 60K.
  • Llama 3.2 1B has downloadable open weights; the other is API-only.

Side by side

Llama 3.2 1B and Step 5 Preview specifications
Llama 3.2 1BStep 5 Preview
ProviderMetaStepFun
Noometry Index20.147.9
Released2024-09-242026-09-16
WeightsOpenProprietary
Context window60K1.02M
Max output54K66K
Input $ / M tokens$0.027$1
Output $ / M tokens$0.20$2.70
Results tracked2218

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 5 Preview leads

Llama 3.2 1B: 21.1 (#338), Step 5 Preview: 51.8 (#36)

Coding benchmarks
BenchmarkLlama 3.2 1BStep 5 Preview
LMArena Coding10701480
LMArena WebDev—1564
SciCode—58.9%
BigCodeBench Instruct8.2%—
BigCodeBench Complete11.3%—

Agentic & Tool Use Not comparable

Llama 3.2 1B: 14.6 (#150), Step 5 Preview: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 1BStep 5 Preview
Berkeley Function Calling Leaderboard10.8%—
BALROG6.6%—

Reasoning Step 5 Preview leads

Llama 3.2 1B: 16.2 (#308), Step 5 Preview: 40.0 (#57)

Reasoning benchmarks
BenchmarkLlama 3.2 1BStep 5 Preview
LMArena Hard Prompts10441465
CritPt—20.9%
Chess Puzzles0%—
Epoch Capabilities Index101.99—

Math Step 5 Preview leads

Llama 3.2 1B: 10.4 (#313), Step 5 Preview: 46.1 (#72)

Math benchmarks
BenchmarkLlama 3.2 1BStep 5 Preview
LMArena Math10861470
OTIS Mock AIME 2024-20250.6%—
ProofBench—42%

Knowledge Step 5 Preview leads

Llama 3.2 1B: 7.2 (#312), Step 5 Preview: 41.2 (#112)

Knowledge benchmarks
BenchmarkLlama 3.2 1BStep 5 Preview
LMArena Expert10071470
GPQA Diamond23.9%—

Multimodal Not comparable

Llama 3.2 1B: —, Step 5 Preview: 41.0 (#41)

Multimodal benchmarks
BenchmarkLlama 3.2 1BStep 5 Preview
LMArena Vision—1267

Multilingual Step 5 Preview leads

Llama 3.2 1B: 23.8 (#292), Step 5 Preview: 53.8 (#54)

Multilingual benchmarks
BenchmarkLlama 3.2 1BStep 5 Preview
LMArena Non-English9731432
LMArena Chinese9591519
LMArena Russian9411436
LMArena German1014—
LMArena Spanish—1439

Instruction Following Step 5 Preview leads

Llama 3.2 1B: 52.4 (#290), Step 5 Preview: 76.0 (#50)

Instruction Following benchmarks
BenchmarkLlama 3.2 1BStep 5 Preview
LMArena Instruction Following10311444

Long Context Step 5 Preview leads

Llama 3.2 1B: 31.9 (#274), Step 5 Preview: 44.5 (#64)

Long Context benchmarks
BenchmarkLlama 3.2 1BStep 5 Preview
LMArena Longer Query10501455

Writing & Preference Step 5 Preview leads

Llama 3.2 1B: 21.3 (#310), Step 5 Preview: 62.8 (#71)

Writing & Preference benchmarks
BenchmarkLlama 3.2 1BStep 5 Preview
LMArena Text10551442
LMArena Creative Writing10331410
LMArena Multi-Turn10301447
EQ-Bench Creative Writing200—

Frequently asked questions

Is Llama 3.2 1B better than Step 5 Preview?

Step 5 Preview is the stronger model overall, scoring 47.9 to 20.1 on the Noometry Index. Llama 3.2 1B costs 20× less per token, which makes it the better buy when Step 5 Preview's lead doesn't matter for your workload.

Which is cheaper, Llama 3.2 1B or Step 5 Preview?

Llama 3.2 1B is cheaper. It lists at $0.027 per million input tokens and $0.20 per million output tokens; Step 5 Preview lists at $1 and $2.70.

Is Llama 3.2 1B or Step 5 Preview better for coding?

Step 5 Preview scores higher on coding benchmarks: 51.8 versus 21.1 in the Noometry coding category.

Which has the bigger context window?

Step 5 Preview does, with 1.02M tokens against 60K.

How many benchmarks do Llama 3.2 1B and Step 5 Preview share?

12 benchmarks have published results for both models. Llama 3.2 1B has 22 scored results on Noometry and Step 5 Preview has 18.

Related comparisons

Go deeper