Model comparison

Granite 3.1 2b Instruct vs Step 1o Turbo 202506

Step 1o Turbo 202506 is the stronger model overall, scoring 39.7 to 33.2 on the Noometry Index.

Last verified . 12 shared benchmarks.

Granite 3.1 2b Instruct IBM

33.2

Rank #247 Confirmed

Step 1o Turbo 202506 StepFun

39.7

Rank #160 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Granite 3.1 2b Instruct scores higher in 0 categories and Step 1o Turbo 202506 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Step 1o Turbo 202506 leads 53.1 to 34.1.
  • Granite 3.1 2b Instruct has downloadable open weights; the other is API-only.

Side by side

Granite 3.1 2b Instruct and Step 1o Turbo 202506 specifications
Granite 3.1 2b InstructStep 1o Turbo 202506
ProviderIBMStepFun
Noometry Index33.239.7
Released——
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1214

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 1o Turbo 202506 leads

Granite 3.1 2b Instruct: 33.4 (#257), Step 1o Turbo 202506: 39.2 (#160)

Coding benchmarks
BenchmarkGranite 3.1 2b InstructStep 1o Turbo 202506
LMArena Coding11491339

Reasoning Step 1o Turbo 202506 leads

Granite 3.1 2b Instruct: 22.0 (#209), Step 1o Turbo 202506: 26.8 (#129)

Reasoning benchmarks
BenchmarkGranite 3.1 2b InstructStep 1o Turbo 202506
LMArena Hard Prompts11381335

Math Step 1o Turbo 202506 leads

Granite 3.1 2b Instruct: 33.1 (#206), Step 1o Turbo 202506: 36.6 (#164)

Math benchmarks
BenchmarkGranite 3.1 2b InstructStep 1o Turbo 202506
LMArena Math11591318

Knowledge Step 1o Turbo 202506 leads

Granite 3.1 2b Instruct: 30.8 (#224), Step 1o Turbo 202506: 36.1 (#176)

Knowledge benchmarks
BenchmarkGranite 3.1 2b InstructStep 1o Turbo 202506
LMArena Expert11311308

Multimodal Not comparable

Granite 3.1 2b Instruct: —, Step 1o Turbo 202506: 36.1 (#80)

Multimodal benchmarks
BenchmarkGranite 3.1 2b InstructStep 1o Turbo 202506
LMArena Vision—1186

Multilingual Step 1o Turbo 202506 leads

Granite 3.1 2b Instruct: 29.1 (#269), Step 1o Turbo 202506: 45.3 (#173)

Multilingual benchmarks
BenchmarkGranite 3.1 2b InstructStep 1o Turbo 202506
LMArena Non-English10681313
LMArena Chinese11391380
LMArena Russian10631327
LMArena German—1314

Instruction Following Step 1o Turbo 202506 leads

Granite 3.1 2b Instruct: 57.7 (#264), Step 1o Turbo 202506: 69.2 (#176)

Instruction Following benchmarks
BenchmarkGranite 3.1 2b InstructStep 1o Turbo 202506
LMArena Instruction Following11161310

Long Context Step 1o Turbo 202506 leads

Granite 3.1 2b Instruct: 35.0 (#244), Step 1o Turbo 202506: 41.0 (#146)

Long Context benchmarks
BenchmarkGranite 3.1 2b InstructStep 1o Turbo 202506
LMArena Longer Query11551348

Writing & Preference Step 1o Turbo 202506 leads

Granite 3.1 2b Instruct: 34.1 (#274), Step 1o Turbo 202506: 53.1 (#160)

Writing & Preference benchmarks
BenchmarkGranite 3.1 2b InstructStep 1o Turbo 202506
LMArena Text11271336
LMArena Creative Writing11161307
LMArena Multi-Turn10991340

Frequently asked questions

Is Granite 3.1 2b Instruct better than Step 1o Turbo 202506?

Step 1o Turbo 202506 is the stronger model overall, scoring 39.7 to 33.2 on the Noometry Index.

Is Granite 3.1 2b Instruct or Step 1o Turbo 202506 better for coding?

Step 1o Turbo 202506 scores higher on coding benchmarks: 39.2 versus 33.4 in the Noometry coding category.

How many benchmarks do Granite 3.1 2b Instruct and Step 1o Turbo 202506 share?

12 benchmarks have published results for both models. Granite 3.1 2b Instruct has 12 scored results on Noometry and Step 1o Turbo 202506 has 14.

Related comparisons

Go deeper