Model comparison

Qwen3-4B vs Step 3.5 Flash

Step 3.5 Flash is the stronger model overall, scoring 42.3 to 31.9 on the Noometry Index.

Last verified . 1 shared benchmarks.

Qwen3-4B Alibaba (Qwen)

31.9

Rank #264 Confirmed

Step 3.5 Flash StepFun

42.3

Rank #116 Confirmed

Summary

  • They share 1 benchmark with published results for both. Qwen3-4B scores higher in 0 categories and Step 3.5 Flash in 3 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in math, where Step 3.5 Flash leads 42.6 to 29.7.
  • The biggest single-benchmark swing is MathArena Final-Answer Competitions: 38.5% for Qwen3-4B and 66.8% for Step 3.5 Flash.

Side by side

Qwen3-4B and Step 3.5 Flash specifications
Qwen3-4BStep 3.5 Flash
ProviderAlibaba (Qwen)StepFun
Noometry Index31.942.3
Released2025-04-292026-01-29
WeightsOpenOpen
Context window—256K
Max output—256K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.30
Results tracked619

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Qwen3-4B: —, Step 3.5 Flash: 42.4 (#105)

Coding benchmarks
BenchmarkQwen3-4BStep 3.5 Flash
LMArena Coding—1436

Agentic & Tool Use Not comparable

Qwen3-4B: 27.6 (#100), Step 3.5 Flash: —

Agentic & Tool Use benchmarks
BenchmarkQwen3-4BStep 3.5 Flash
Berkeley Function Calling Leaderboard35.7%—

Reasoning Step 3.5 Flash leads

Qwen3-4B: 19.2 (#268), Step 3.5 Flash: 22.2 (#202)

Reasoning benchmarks
BenchmarkQwen3-4BStep 3.5 Flash
NYT Connections (extended)—28.4%
Chess Puzzles4%—
LMArena Hard Prompts—1411

Math Step 3.5 Flash leads

Qwen3-4B: 29.7 (#240), Step 3.5 Flash: 42.6 (#84)

Math benchmarks
BenchmarkQwen3-4BStep 3.5 Flash
MathArena Final-Answer Competitions38.5%66.8%
OTIS Mock AIME 2024-202552.2%—
LMArena Math—1408

Knowledge Step 3.5 Flash leads

Qwen3-4B: 33.0 (#208), Step 3.5 Flash: 39.6 (#132)

Knowledge benchmarks
BenchmarkQwen3-4BStep 3.5 Flash
GPQA Diamond52.3%—
Vectara Hallucination Rate5.7%—
LMArena Expert—1421

Multilingual Not comparable

Qwen3-4B: —, Step 3.5 Flash: 50.5 (#119)

Multilingual benchmarks
BenchmarkQwen3-4BStep 3.5 Flash
LMArena Non-English—1385
LMArena Chinese—1447
LMArena French—1421
LMArena German—1405
LMArena Japanese—1354
LMArena Korean—1352
LMArena Russian—1385
LMArena Spanish—1419

Instruction Following Not comparable

Qwen3-4B: —, Step 3.5 Flash: 73.1 (#124)

Instruction Following benchmarks
BenchmarkQwen3-4BStep 3.5 Flash
LMArena Instruction Following—1385

Long Context Not comparable

Qwen3-4B: —, Step 3.5 Flash: 42.8 (#117)

Long Context benchmarks
BenchmarkQwen3-4BStep 3.5 Flash
LMArena Longer Query—1402

Writing & Preference Not comparable

Qwen3-4B: —, Step 3.5 Flash: 58.8 (#113)

Writing & Preference benchmarks
BenchmarkQwen3-4BStep 3.5 Flash
LMArena Text—1403
LMArena Creative Writing—1357
LMArena Multi-Turn—1405

Frequently asked questions

Is Qwen3-4B better than Step 3.5 Flash?

Step 3.5 Flash is the stronger model overall, scoring 42.3 to 31.9 on the Noometry Index.

How many benchmarks do Qwen3-4B and Step 3.5 Flash share?

1 benchmark has published results for both models. Qwen3-4B has 6 scored results on Noometry and Step 3.5 Flash has 19.

Related comparisons

Go deeper