Model comparison

Mistral Large 4 vs Step 2 16k Exp 202412

Mistral Large 4 is the stronger model overall, scoring 43.1 to 39.2 on the Noometry Index.

Last verified . 12 shared benchmarks.

Mistral Large 4 Mistral AI

43.1

Rank #99 Confirmed

Step 2 16k Exp 202412 StepFun

39.2

Rank #171 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Mistral Large 4 scores higher in 7 categories and Step 2 16k Exp 202412 in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Mistral Large 4 leads 48.6 to 38.5.

Side by side

Mistral Large 4 and Step 2 16k Exp 202412 specifications
Mistral Large 4Step 2 16k Exp 202412
ProviderMistral AIStepFun
Noometry Index43.139.2
Released2026-10-06—
WeightsProprietaryProprietary
Context window1.05M—
Max output262K—
Input $ / M tokens$0.68—
Output $ / M tokens$2.09—
Results tracked1512

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Large 4 leads

Mistral Large 4: 48.6 (#57), Step 2 16k Exp 202412: 38.5 (#174)

Coding benchmarks
BenchmarkMistral Large 4Step 2 16k Exp 202412
LMArena Coding14751316
LMArena WebDev1541—

Reasoning Step 2 16k Exp 202412 leads

Mistral Large 4: 22.5 (#192), Step 2 16k Exp 202412: 25.9 (#142)

Reasoning benchmarks
BenchmarkMistral Large 4Step 2 16k Exp 202412
LMArena Hard Prompts14441299
NYT Connections (extended)27.4%—

Math Mistral Large 4 leads

Mistral Large 4: 40.4 (#91), Step 2 16k Exp 202412: 36.3 (#169)

Math benchmarks
BenchmarkMistral Large 4Step 2 16k Exp 202412
LMArena Math14881304

Knowledge Mistral Large 4 leads

Mistral Large 4: 36.6 (#166), Step 2 16k Exp 202412: 35.2 (#187)

Knowledge benchmarks
BenchmarkMistral Large 4Step 2 16k Exp 202412
LMArena Expert14471279
SimpleQA Verified20%—

Multilingual Mistral Large 4 leads

Mistral Large 4: 52.6 (#82), Step 2 16k Exp 202412: 43.7 (#181)

Multilingual benchmarks
BenchmarkMistral Large 4Step 2 16k Exp 202412
LMArena Non-English14151290
LMArena Chinese14911331
LMArena Russian14141324

Instruction Following Mistral Large 4 leads

Mistral Large 4: 75.0 (#76), Step 2 16k Exp 202412: 67.9 (#192)

Instruction Following benchmarks
BenchmarkMistral Large 4Step 2 16k Exp 202412
LMArena Instruction Following14241287

Long Context Mistral Large 4 leads

Mistral Large 4: 43.6 (#89), Step 2 16k Exp 202412: 39.7 (#170)

Long Context benchmarks
BenchmarkMistral Large 4Step 2 16k Exp 202412
LMArena Longer Query14291307

Writing & Preference Mistral Large 4 leads

Mistral Large 4: 60.4 (#97), Step 2 16k Exp 202412: 52.3 (#173)

Writing & Preference benchmarks
BenchmarkMistral Large 4Step 2 16k Exp 202412
LMArena Text14271321
LMArena Creative Writing13611328
LMArena Multi-Turn14241292

Frequently asked questions

Is Mistral Large 4 better than Step 2 16k Exp 202412?

Mistral Large 4 is the stronger model overall, scoring 43.1 to 39.2 on the Noometry Index.

Is Mistral Large 4 or Step 2 16k Exp 202412 better for coding?

Mistral Large 4 scores higher on coding benchmarks: 48.6 versus 38.5 in the Noometry coding category.

How many benchmarks do Mistral Large 4 and Step 2 16k Exp 202412 share?

12 benchmarks have published results for both models. Mistral Large 4 has 15 scored results on Noometry and Step 2 16k Exp 202412 has 12.

Related comparisons

Go deeper