Model comparison
Qwen3 8B vs Step 3.7 Flash
Step 3.7 Flash is the stronger model overall, scoring 37.3 to 33.7 on the Noometry Index.
Last verified . 2 shared benchmarks.
Summary
- They share 2 benchmarks with published results for both. Qwen3 8B scores higher in 0 categories and Step 3.7 Flash in 3 categories; 3 gaps are clear of the uncertainty.
- The widest gap is in math, where Step 3.7 Flash leads 42.9 to 34.9.
- The biggest single-benchmark swing is SciCode: 22.6% for Qwen3 8B and 40% for Step 3.7 Flash.
- Qwen3 8B is cheaper at $0.18 / $0.70 per million input/output tokens, against $0.18 / $1.11 for Step 3.7 Flash.
- Step 3.7 Flash accepts more context: 256K tokens versus 131K.
Side by side
| Qwen3 8B | Step 3.7 Flash | |
|---|---|---|
| Provider | Alibaba (Qwen) | StepFun |
| Noometry Index | 33.7 | 37.3 |
| Released | 2025-04 | 2026-05-29 |
| Weights | Open | Open |
| Context window | 131K | 256K |
| Max output | 8K | 256K |
| Input $ / M tokens | $0.18 | $0.18 |
| Output $ / M tokens | $0.70 | $1.11 |
| Results tracked | 11 | 5 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Step 3.7 Flash leads
Qwen3 8B: 34.0 (#248), Step 3.7 Flash: 40.0 (#150)
Agentic & Tool Use Not comparable
Qwen3 8B: 30.2 (#78), Step 3.7 Flash: —
| Benchmark | Qwen3 8B | Step 3.7 Flash |
|---|---|---|
| Berkeley Function Calling Leaderboard | 42.6% | — |
Reasoning Step 3.7 Flash leads
Qwen3 8B: 16.6 (#303), Step 3.7 Flash: 21.6 (#219)
| Benchmark | Qwen3 8B | Step 3.7 Flash |
|---|---|---|
| CritPt | 0% | 2.3% |
| NYT Connections (extended) | — | 39.7% |
| Chess Puzzles | 5% | — |
| DTBench | 59.7% | — |
| LMCA | 8.8% | — |
| Epoch Capabilities Index | 136.17 | — |
Math Step 3.7 Flash leads
Qwen3 8B: 34.9 (#191), Step 3.7 Flash: 42.9 (#82)
| Benchmark | Qwen3 8B | Step 3.7 Flash |
|---|---|---|
| MathArena Final-Answer Competitions | — | 68.5% |
| OTIS Mock AIME 2024-2025 | 56.1% | — |
Knowledge Not comparable
Qwen3 8B: 36.1 (#173), Step 3.7 Flash: —
| Benchmark | Qwen3 8B | Step 3.7 Flash |
|---|---|---|
| GPQA Diamond | 56.8% | — |
| Vectara Hallucination Rate | 4.8% | — |
Long Context Not comparable
Qwen3 8B: 37.9 (#210), Step 3.7 Flash: —
| Benchmark | Qwen3 8B | Step 3.7 Flash |
|---|---|---|
| Fiction.LiveBench | 62.1% | — |
Frequently asked questions
Is Qwen3 8B better than Step 3.7 Flash?
Step 3.7 Flash is the stronger model overall, scoring 37.3 to 33.7 on the Noometry Index.
Which is cheaper, Qwen3 8B or Step 3.7 Flash?
Qwen3 8B is cheaper. It lists at $0.18 per million input tokens and $0.70 per million output tokens; Step 3.7 Flash lists at $0.18 and $1.11.
Is Qwen3 8B or Step 3.7 Flash better for coding?
Step 3.7 Flash scores higher on coding benchmarks: 40.0 versus 34.0 in the Noometry coding category.
Which has the bigger context window?
Step 3.7 Flash does, with 256K tokens against 131K.
How many benchmarks do Qwen3 8B and Step 3.7 Flash share?
2 benchmarks have published results for both models. Qwen3 8B has 11 scored results on Noometry and Step 3.7 Flash has 5.