Model comparison

Pixtral Large vs Step 3.5 Flash

Step 3.5 Flash is the stronger model overall, scoring 42.3 to 32.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Pixtral Large Mistral AI

32.2

Rank #259 Reported

Step 3.5 Flash StepFun

42.3

Rank #116 Confirmed

Summary

  • The widest gap is in writing & preference, where Step 3.5 Flash leads 58.8 to 32.9.
  • Step 3.5 Flash is cheaper at $0.10 / $0.30 per million input/output tokens, against $2 / $6 for Pixtral Large.
  • Step 3.5 Flash accepts more context: 256K tokens versus 128K.

Side by side

Pixtral Large and Step 3.5 Flash specifications
Pixtral LargeStep 3.5 Flash
ProviderMistral AIStepFun
Noometry Index32.242.3
Released2024-11-012026-01-29
WeightsOpenOpen
Context window128K256K
Max output128K256K
Input $ / M tokens$2$0.10
Output $ / M tokens$6$0.30
Results tracked319

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Pixtral Large: —, Step 3.5 Flash: 42.4 (#105)

Coding benchmarks
BenchmarkPixtral LargeStep 3.5 Flash
LMArena Coding—1436

Reasoning Too close to call

Pixtral Large: 21.7 (#218), Step 3.5 Flash: 22.2 (#202)

Reasoning benchmarks
BenchmarkPixtral LargeStep 3.5 Flash
NYT Connections (extended)—28.4%
EnigmaEval0.8%—
LMArena Hard Prompts—1411

Math Not comparable

Pixtral Large: —, Step 3.5 Flash: 42.6 (#84)

Math benchmarks
BenchmarkPixtral LargeStep 3.5 Flash
MathArena Final-Answer Competitions—66.8%
LMArena Math—1408

Knowledge Not comparable

Pixtral Large: —, Step 3.5 Flash: 39.6 (#132)

Knowledge benchmarks
BenchmarkPixtral LargeStep 3.5 Flash
LMArena Expert—1421

Multimodal Not comparable

Pixtral Large: 30.6 (#111), Step 3.5 Flash: —

Multimodal benchmarks
BenchmarkPixtral LargeStep 3.5 Flash
LMArena Vision1089—

Multilingual Not comparable

Pixtral Large: —, Step 3.5 Flash: 50.5 (#119)

Multilingual benchmarks
BenchmarkPixtral LargeStep 3.5 Flash
LMArena Non-English—1385
LMArena Chinese—1447
LMArena French—1421
LMArena German—1405
LMArena Japanese—1354
LMArena Korean—1352
LMArena Russian—1385
LMArena Spanish—1419

Instruction Following Not comparable

Pixtral Large: —, Step 3.5 Flash: 73.1 (#124)

Instruction Following benchmarks
BenchmarkPixtral LargeStep 3.5 Flash
LMArena Instruction Following—1385

Long Context Not comparable

Pixtral Large: —, Step 3.5 Flash: 42.8 (#117)

Long Context benchmarks
BenchmarkPixtral LargeStep 3.5 Flash
LMArena Longer Query—1402

Writing & Preference Step 3.5 Flash leads

Pixtral Large: 32.9 (#278), Step 3.5 Flash: 58.8 (#113)

Writing & Preference benchmarks
BenchmarkPixtral LargeStep 3.5 Flash
LMArena Text—1403
LMArena Creative Writing—1357
EQ-Bench Creative Writing988—
LMArena Multi-Turn—1405

Frequently asked questions

Is Pixtral Large better than Step 3.5 Flash?

Step 3.5 Flash is the stronger model overall, scoring 42.3 to 32.2 on the Noometry Index.

Which is cheaper, Pixtral Large or Step 3.5 Flash?

Step 3.5 Flash is cheaper. It lists at $0.10 per million input tokens and $0.30 per million output tokens; Pixtral Large lists at $2 and $6.

Which has the bigger context window?

Step 3.5 Flash does, with 256K tokens against 128K.

How many benchmarks do Pixtral Large and Step 3.5 Flash share?

0 benchmarks have published results for both models. Pixtral Large has 3 scored results on Noometry and Step 3.5 Flash has 19.

Related comparisons

Go deeper