Model comparison

Sonar vs Step 3.5 Flash

Step 3.5 Flash is the stronger model overall, scoring 42.3 to 38.5 on the Noometry Index.

Last verified . 0 shared benchmarks.

Sonar Perplexity

38.5

Rank #187 Confirmed

Step 3.5 Flash StepFun

42.3

Rank #116 Confirmed

Summary

  • The widest gap is in math, where Step 3.5 Flash leads 42.6 to 33.7.
  • Step 3.5 Flash is cheaper at $0.10 / $0.30 per million input/output tokens, against $1 / $1 for Sonar.
  • Step 3.5 Flash accepts more context: 256K tokens versus 128K.
  • Step 3.5 Flash has downloadable open weights; the other is API-only.

Side by side

Sonar and Step 3.5 Flash specifications
SonarStep 3.5 Flash
ProviderPerplexityStepFun
Noometry Index38.542.3
Released2024-01-012026-01-29
WeightsProprietaryOpen
Context window128K256K
Max output4K256K
Input $ / M tokens$1$0.10
Output $ / M tokens$1$0.30
Results tracked719

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Step 3.5 Flash leads

Sonar: 35.7 (#221), Step 3.5 Flash: 42.4 (#105)

Coding benchmarks
BenchmarkSonarStep 3.5 Flash
LiveBench Coding35.1%—
LMArena Coding—1436

Reasoning Step 3.5 Flash leads

Sonar: 21.1 (#227), Step 3.5 Flash: 22.2 (#202)

Reasoning benchmarks
BenchmarkSonarStep 3.5 Flash
NYT Connections (extended)—28.4%
LiveBench Reasoning46.3%—
LMArena Hard Prompts—1411
LiveBench Data Analysis37.9%—
LiveBench46.9%—

Math Step 3.5 Flash leads

Sonar: 33.7 (#200), Step 3.5 Flash: 42.6 (#84)

Math benchmarks
BenchmarkSonarStep 3.5 Flash
MathArena Final-Answer Competitions—66.8%
LiveBench Math41.6%—
LMArena Math—1408

Knowledge Not comparable

Sonar: —, Step 3.5 Flash: 39.6 (#132)

Knowledge benchmarks
BenchmarkSonarStep 3.5 Flash
LMArena Expert—1421

Multilingual Not comparable

Sonar: —, Step 3.5 Flash: 50.5 (#119)

Multilingual benchmarks
BenchmarkSonarStep 3.5 Flash
LMArena Non-English—1385
LMArena Chinese—1447
LMArena French—1421
LMArena German—1405
LMArena Japanese—1354
LMArena Korean—1352
LMArena Russian—1385
LMArena Spanish—1419

Instruction Following Step 3.5 Flash leads

Sonar: 71.4 (#150), Step 3.5 Flash: 73.1 (#124)

Instruction Following benchmarks
BenchmarkSonarStep 3.5 Flash
LiveBench Instruction Following76.2%—
LMArena Instruction Following—1385

Long Context Not comparable

Sonar: —, Step 3.5 Flash: 42.8 (#117)

Long Context benchmarks
BenchmarkSonarStep 3.5 Flash
LMArena Longer Query—1402

Writing & Preference Step 3.5 Flash leads

Sonar: 52.6 (#167), Step 3.5 Flash: 58.8 (#113)

Writing & Preference benchmarks
BenchmarkSonarStep 3.5 Flash
LMArena Text—1403
LMArena Creative Writing—1357
LMArena Multi-Turn—1405
LiveBench Language44.1%—

Frequently asked questions

Is Sonar better than Step 3.5 Flash?

Step 3.5 Flash is the stronger model overall, scoring 42.3 to 38.5 on the Noometry Index.

Which is cheaper, Sonar or Step 3.5 Flash?

Step 3.5 Flash is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; Sonar lists at $1 and $1.

Is Sonar or Step 3.5 Flash better for coding?

Step 3.5 Flash scores higher on coding benchmarks: 42.4 versus 35.7 in the Noometry coding category.

Which has the bigger context window?

Step 3.5 Flash does, with 256K tokens against 128K.

How many benchmarks do Sonar and Step 3.5 Flash share?

0 benchmarks have published results for both models. Sonar has 7 scored results on Noometry and Step 3.5 Flash has 19.

Related comparisons

Go deeper