Model comparison

Qwen Turbo vs Step 3

Step 3 is the stronger model overall, scoring 40.5 to 27.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Qwen Turbo Alibaba (Qwen)

27.1

Rank #335 Reported

Step 3 StepFun

40.5

Rank #149 Confirmed

Summary

  • The widest gap is in math, where Step 3 leads 37.6 to 15.3.
  • Step 3 has downloadable open weights; the other is API-only.

Side by side

Qwen Turbo and Step 3 specifications
Qwen TurboStep 3
ProviderAlibaba (Qwen)StepFun
Noometry Index27.140.5
Released2024-11-01—
WeightsProprietaryOpen
Context window1M—
Max output16K—
Input $ / M tokens$0.05—
Output $ / M tokens$0.20—
Results tracked317

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Qwen Turbo: —, Step 3: 40.1 (#147)

Coding benchmarks
BenchmarkQwen TurboStep 3
LMArena Coding—1367

Reasoning Not comparable

Qwen Turbo: —, Step 3: 28.4 (#105)

Reasoning benchmarks
BenchmarkQwen TurboStep 3
Kagi LLM Benchmark—62.3%
LMArena Hard Prompts—1355

Math Step 3 leads

Qwen Turbo: 15.3 (#297), Step 3: 37.6 (#148)

Math benchmarks
BenchmarkQwen TurboStep 3
OTIS Mock AIME 2024-20256.1%—
LMArena Math—1366
MATH Level 556.2%—

Knowledge Step 3 leads

Qwen Turbo: 22.2 (#272), Step 3: 36.8 (#164)

Knowledge benchmarks
BenchmarkQwen TurboStep 3
GPQA Diamond41.8%—
LMArena Expert—1333

Multimodal Not comparable

Qwen Turbo: —, Step 3: 35.5 (#86)

Multimodal benchmarks
BenchmarkQwen TurboStep 3
LMArena Vision—1177

Multilingual Not comparable

Qwen Turbo: —, Step 3: 46.3 (#159)

Multilingual benchmarks
BenchmarkQwen TurboStep 3
LMArena Non-English—1327
LMArena Chinese—1397
LMArena German—1371
LMArena Korean—1269
LMArena Russian—1331
LMArena Spanish—1371

Instruction Following Not comparable

Qwen Turbo: —, Step 3: 70.4 (#164)

Instruction Following benchmarks
BenchmarkQwen TurboStep 3
LMArena Instruction Following—1332

Long Context Not comparable

Qwen Turbo: —, Step 3: 40.3 (#157)

Long Context benchmarks
BenchmarkQwen TurboStep 3
LMArena Longer Query—1326

Writing & Preference Not comparable

Qwen Turbo: —, Step 3: 54.3 (#151)

Writing & Preference benchmarks
BenchmarkQwen TurboStep 3
LMArena Text—1350
LMArena Creative Writing—1321
LMArena Multi-Turn—1341

Frequently asked questions

Is Qwen Turbo better than Step 3?

Step 3 is the stronger model overall, scoring 40.5 to 27.1 on the Noometry Index.

How many benchmarks do Qwen Turbo and Step 3 share?

0 benchmarks have published results for both models. Qwen Turbo has 3 scored results on Noometry and Step 3 has 17.

Related comparisons

Go deeper