Model comparison

Llama-3.3-70B-Instruct vs Step 3.5 Flash

Step 3.5 Flash is the stronger model overall, scoring 42.3 to 30.6 on the Noometry Index.

Last verified . 17 shared benchmarks.

Llama-3.3-70B-Instruct Meta

30.6

Rank #291 Confirmed

Step 3.5 Flash StepFun

42.3

Rank #116 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Llama-3.3-70B-Instruct scores higher in 0 categories and Step 3.5 Flash in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Step 3.5 Flash leads 42.6 to 15.3.
  • Both cost about the same: $0.10 input and $0.32 output per million tokens.
  • Step 3.5 Flash accepts more context: 256K tokens versus 128K.

Side by side

Llama-3.3-70B-Instruct and Step 3.5 Flash specifications
Llama-3.3-70B-InstructStep 3.5 Flash
ProviderMetaStepFun
Noometry Index30.642.3
Released2024-12-062026-01-29
WeightsOpenOpen
Context window128K256K
Max output4K256K
Input $ / M tokens$0.10$0.10
Output $ / M tokens$0.32$0.30
Results tracked4319

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.5 Flash leads

Llama-3.3-70B-Instruct: 31.0 (#290), Step 3.5 Flash: 42.4 (#105)

Coding benchmarks
BenchmarkLlama-3.3-70B-InstructStep 3.5 Flash
LMArena Coding12681436
SciCode26%—
WeirdML14.4%—
BigCodeBench Instruct46.9%—
LiveBench Coding36.6%—
BigCodeBench Complete57.5%—

Agentic & Tool Use Not comparable

Llama-3.3-70B-Instruct: 25.8 (#105), Step 3.5 Flash: —

Agentic & Tool Use benchmarks
BenchmarkLlama-3.3-70B-InstructStep 3.5 Flash
Berkeley Function Calling Leaderboard31.9%—
BALROG23%—

Reasoning Step 3.5 Flash leads

Llama-3.3-70B-Instruct: 14.1 (#327), Step 3.5 Flash: 22.2 (#202)

Reasoning benchmarks
BenchmarkLlama-3.3-70B-InstructStep 3.5 Flash
LMArena Hard Prompts12571411
SimpleBench19.9%—
NYT Connections (extended)—28.4%
CritPt0%—
LiveBench Reasoning50.8%—
DTBench59.5%—
LiveBench Data Analysis49.5%—
LMCA17.5%—
Epoch Capabilities Index127.33—
ForecastBench58.6—
LiveBench50.2%—

Math Step 3.5 Flash leads

Llama-3.3-70B-Instruct: 15.3 (#298), Step 3.5 Flash: 42.6 (#84)

Math benchmarks
BenchmarkLlama-3.3-70B-InstructStep 3.5 Flash
LMArena Math12671408
MathArena Final-Answer Competitions—66.8%
OTIS Mock AIME 2024-20255.1%—
LiveBench Math42.2%—
MATH Level 541.6%—

Knowledge Step 3.5 Flash leads

Llama-3.3-70B-Instruct: 30.6 (#226), Step 3.5 Flash: 39.6 (#132)

Knowledge benchmarks
BenchmarkLlama-3.3-70B-InstructStep 3.5 Flash
LMArena Expert12251421
GPQA Diamond47.4%—
Confabulations22.8%—
Vectara Hallucination Rate4.1%—
MMLU86.3%—

Multilingual Step 3.5 Flash leads

Llama-3.3-70B-Instruct: 39.9 (#220), Step 3.5 Flash: 50.5 (#119)

Multilingual benchmarks
BenchmarkLlama-3.3-70B-InstructStep 3.5 Flash
LMArena Non-English12361385
LMArena Chinese12171447
LMArena French12811421
LMArena German12511405
LMArena Japanese11501354
LMArena Korean11431352
LMArena Russian12521385
LMArena Spanish12701419

Instruction Following Step 3.5 Flash leads

Llama-3.3-70B-Instruct: 71.1 (#157), Step 3.5 Flash: 73.1 (#124)

Instruction Following benchmarks
BenchmarkLlama-3.3-70B-InstructStep 3.5 Flash
LMArena Instruction Following12421385
LiveBench Instruction Following82.7%—

Long Context Step 3.5 Flash leads

Llama-3.3-70B-Instruct: 26.4 (#295), Step 3.5 Flash: 42.8 (#117)

Long Context benchmarks
BenchmarkLlama-3.3-70B-InstructStep 3.5 Flash
LMArena Longer Query12561402
Fiction.LiveBench33.3%—

Writing & Preference Step 3.5 Flash leads

Llama-3.3-70B-Instruct: 47.6 (#207), Step 3.5 Flash: 58.8 (#113)

Writing & Preference benchmarks
BenchmarkLlama-3.3-70B-InstructStep 3.5 Flash
LMArena Text12741403
LMArena Creative Writing12501357
LMArena Multi-Turn12801405
LiveBench Language39.2%—

Frequently asked questions

Is Llama-3.3-70B-Instruct better than Step 3.5 Flash?

Step 3.5 Flash is the stronger model overall, scoring 42.3 to 30.6 on the Noometry Index.

Which is cheaper, Llama-3.3-70B-Instruct or Step 3.5 Flash?

Step 3.5 Flash is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; Llama-3.3-70B-Instruct lists at $0.10 and $0.32.

Is Llama-3.3-70B-Instruct or Step 3.5 Flash better for coding?

Step 3.5 Flash scores higher on coding benchmarks: 42.4 versus 31.0 in the Noometry coding category.

Which has the bigger context window?

Step 3.5 Flash does, with 256K tokens against 128K.

How many benchmarks do Llama-3.3-70B-Instruct and Step 3.5 Flash share?

17 benchmarks have published results for both models. Llama-3.3-70B-Instruct has 43 scored results on Noometry and Step 3.5 Flash has 19.

Related comparisons

Go deeper