Model comparison

Llama 3.2 90B vs Step 3

Step 3 is the stronger model overall, scoring 39.9 to 27.1 on the Noometry Index.

Last verified . 1 shared benchmarks.

Llama 3.2 90B Meta

27.1

Rank #326 Confirmed

Step 3 StepFun

39.9

Rank #145 Confirmed

Summary

  • They share 1 benchmark with published results for both. Llama 3.2 90B scores higher in 0 categories and Step 3 in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Step 3 leads 34.9 to 10.4.

Side by side

Llama 3.2 90B and Step 3 specifications
Llama 3.2 90BStep 3
ProviderMetaStepFun
Noometry Index27.139.9
Released2024-09-24—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked917

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 3.2 90B: —, Step 3: 39.5 (#144)

Coding benchmarks
BenchmarkLlama 3.2 90BStep 3
LMArena Coding—1367

Agentic & Tool Use Not comparable

Llama 3.2 90B: 29.7 (#73), Step 3: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 90BStep 3
BALROG27.3%—

Reasoning Step 3 leads

Llama 3.2 90B: 20.9 (#207), Step 3: 27.6 (#102)

Reasoning benchmarks
BenchmarkLlama 3.2 90BStep 3
Kagi LLM Benchmark—62.3%
EnigmaEval0.4%—
LMArena Hard Prompts—1355
Epoch Capabilities Index125.5—

Math Step 3 leads

Llama 3.2 90B: 10.4 (#302), Step 3: 34.9 (#148)

Math benchmarks
BenchmarkLlama 3.2 90BStep 3
OTIS Mock AIME 2024-20252.6%—
LMArena Math—1366
MATH Level 539.4%—

Knowledge Step 3 leads

Llama 3.2 90B: 21.7 (#269), Step 3: 36.2 (#161)

Knowledge benchmarks
BenchmarkLlama 3.2 90BStep 3
GPQA Diamond41%—
LMArena Expert—1333
MMLU80.3%—

Multimodal Step 3 leads

Llama 3.2 90B: 24.9 (#119), Step 3: 34.9 (#81)

Multimodal benchmarks
BenchmarkLlama 3.2 90BStep 3
LMArena Vision10001176
GeoBench52%—

Multilingual Not comparable

Llama 3.2 90B: —, Step 3: 46.5 (#154)

Multilingual benchmarks
BenchmarkLlama 3.2 90BStep 3
LMArena Non-English—1327
LMArena Chinese—1396
LMArena German—1371
LMArena Korean—1271
LMArena Russian—1331
LMArena Spanish—1372

Instruction Following Not comparable

Llama 3.2 90B: —, Step 3: 70.6 (#159)

Instruction Following benchmarks
BenchmarkLlama 3.2 90BStep 3
LMArena Instruction Following—1332

Long Context Not comparable

Llama 3.2 90B: —, Step 3: 40.3 (#152)

Long Context benchmarks
BenchmarkLlama 3.2 90BStep 3
LMArena Longer Query—1326

Writing & Preference Not comparable

Llama 3.2 90B: —, Step 3: 54.5 (#146)

Writing & Preference benchmarks
BenchmarkLlama 3.2 90BStep 3
LMArena Text—1351
LMArena Creative Writing—1322
LMArena Multi-Turn—1340

Frequently asked questions

Is Llama 3.2 90B better than Step 3?

Step 3 is the stronger model overall, scoring 39.9 to 27.1 on the Noometry Index.

How many benchmarks do Llama 3.2 90B and Step 3 share?

1 benchmark has published results for both models. Llama 3.2 90B has 9 scored results on Noometry and Step 3 has 17.

Related comparisons

Go deeper