Model comparison

DBRX vs Step 1o Turbo 202506

Step 1o Turbo 202506 is the stronger model overall, scoring 39.7 to 29.4 on the Noometry Index.

Last verified . 13 shared benchmarks.

DBRX Databricks

29.4

Rank #311 Confirmed

Step 1o Turbo 202506 StepFun

39.7

Rank #160 Confirmed

Summary

  • They share 13 benchmarks with published results for both. DBRX scores higher in 0 categories and Step 1o Turbo 202506 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Step 1o Turbo 202506 leads 36.1 to 14.9.
  • DBRX has downloadable open weights; the other is API-only.

Side by side

DBRX and Step 1o Turbo 202506 specifications
DBRXStep 1o Turbo 202506
ProviderDatabricksStepFun
Noometry Index29.439.7
Released2024-03-27—
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2114

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 1o Turbo 202506 leads

DBRX: 32.9 (#266), Step 1o Turbo 202506: 39.2 (#160)

Coding benchmarks
BenchmarkDBRXStep 1o Turbo 202506
LMArena Coding11321339
HumanEval+70.1%—
MBPP+55.8%—

Reasoning Step 1o Turbo 202506 leads

DBRX: 21.4 (#222), Step 1o Turbo 202506: 26.8 (#129)

Reasoning benchmarks
BenchmarkDBRXStep 1o Turbo 202506
LMArena Hard Prompts11131335

Math Step 1o Turbo 202506 leads

DBRX: 24.3 (#269), Step 1o Turbo 202506: 36.6 (#164)

Math benchmarks
BenchmarkDBRXStep 1o Turbo 202506
LMArena Math11451318
MATH Level 511.7%—

Knowledge Step 1o Turbo 202506 leads

DBRX: 14.9 (#294), Step 1o Turbo 202506: 36.1 (#176)

Knowledge benchmarks
BenchmarkDBRXStep 1o Turbo 202506
LMArena Expert10761308
GPQA Diamond32.9%—

Multimodal Not comparable

DBRX: —, Step 1o Turbo 202506: 36.1 (#80)

Multimodal benchmarks
BenchmarkDBRXStep 1o Turbo 202506
LMArena Vision—1186

Multilingual Step 1o Turbo 202506 leads

DBRX: 29.3 (#268), Step 1o Turbo 202506: 45.3 (#173)

Multilingual benchmarks
BenchmarkDBRXStep 1o Turbo 202506
LMArena Non-English10711313
LMArena Chinese10681380
LMArena German10571314
LMArena Russian10781327
LMArena French1096—
LMArena Japanese990—
LMArena Korean993—
LMArena Spanish1064—

Instruction Following Step 1o Turbo 202506 leads

DBRX: 57.5 (#270), Step 1o Turbo 202506: 69.2 (#176)

Instruction Following benchmarks
BenchmarkDBRXStep 1o Turbo 202506
LMArena Instruction Following11121310

Long Context Step 1o Turbo 202506 leads

DBRX: 33.7 (#258), Step 1o Turbo 202506: 41.0 (#146)

Long Context benchmarks
BenchmarkDBRXStep 1o Turbo 202506
LMArena Longer Query11121348

Writing & Preference Step 1o Turbo 202506 leads

DBRX: 33.6 (#275), Step 1o Turbo 202506: 53.1 (#160)

Writing & Preference benchmarks
BenchmarkDBRXStep 1o Turbo 202506
LMArena Text11191336
LMArena Creative Writing11041307
LMArena Multi-Turn11111340

Frequently asked questions

Is DBRX better than Step 1o Turbo 202506?

Step 1o Turbo 202506 is the stronger model overall, scoring 39.7 to 29.4 on the Noometry Index.

Is DBRX or Step 1o Turbo 202506 better for coding?

Step 1o Turbo 202506 scores higher on coding benchmarks: 39.2 versus 32.9 in the Noometry coding category.

How many benchmarks do DBRX and Step 1o Turbo 202506 share?

13 benchmarks have published results for both models. DBRX has 21 scored results on Noometry and Step 1o Turbo 202506 has 14.

Related comparisons

Go deeper