Noometry

Model comparison

Devstral 2 vs Grok 4.5

Grok 4.5 has enough public results to be ranked (#22); Devstral 2 does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Devstral 2 Mistral AI

35.8

Unranked Sparse

Grok 4.5 xAI

55.0

Rank #22 Confirmed

Summary

  • They share 1 benchmark with published results for both. Devstral 2 scores higher in 0 categories and Grok 4.5 in 1 category; one gap is clear of the uncertainty.
  • The widest gap is in coding, where Grok 4.5 leads 51.7 to 33.0.
  • Devstral 2 is cheaper at $0.40 / $2 per million input/output tokens, against $2 / $6 for Grok 4.5.
  • Grok 4.5 accepts more context: 500K tokens versus 262K.
  • Devstral 2 has downloadable open weights; the other is API-only.

Side by side

Devstral 2Grok 4.5
ProviderMistral AIxAI
Noometry Index35.855.0
Released2025-12-092026-07-08
WeightsOpenProprietary
Context window262K500K
Max output262K500K
Input $ / M tokens$0.40$2
Output $ / M tokens$2$6
Results tracked252

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.5 leads

Devstral 2: 33.0 (#253), Grok 4.5: 51.7 (#34)

BenchmarkDevstral 2Grok 4.5
LMArena WebDev11961552
DeepSWE—53.8%
FrontierCode—42.4%
SWE-bench Verified (bash only)53.8%—
SciCode—54.1%
WeirdML—46.4%
LMArena Coding—1473
ALE-Bench—1,309

Agentic & Tool Use Not comparable

Devstral 2: —, Grok 4.5: 44.4 (#15)

BenchmarkDevstral 2Grok 4.5
APEX-Agents—56.2%
τ²-bench Banking—47.9%
PostTrainBench—23.4%
GBAEval—65.4%
GDP.pdf—14%
LMArena Search—1213
Vending-Bench 2—3,887

Reasoning Not comparable

Devstral 2: —, Grok 4.5: 56.0 (#23)

BenchmarkDevstral 2Grok 4.5
ARC-AGI-2—52.6%
SimpleBench—70%
Kagi LLM Benchmark—83.5%
NYT Connections (extended)—79.9%
ARC-AGI-1—87.2%
CritPt—15.4%
Chess Puzzles—36%
LMArena Hard Prompts—1462
DTBench—96.5%
LMCA—45.2%
Surface Evolver Bench—74.4%
Epoch Capabilities Index—154.02

Math Not comparable

Devstral 2: —, Grok 4.5: 60.7 (#29)

BenchmarkDevstral 2Grok 4.5
FrontierMath (Tiers 1-3)—57.2%
FrontierMath Tier 4—24.4%
OTIS Mock AIME 2024-2025—97.8%
ProofBench—31%
LMArena Math—1457

Knowledge Not comparable

Devstral 2: —, Grok 4.5: 62.3 (#21)

BenchmarkDevstral 2Grok 4.5
GPQA Diamond—93.4%
SimpleQA Verified—48.3%
LMArena Expert—1466

Multimodal Not comparable

Devstral 2: —, Grok 4.5: 37.8 (#63)

BenchmarkDevstral 2Grok 4.5
LMArena Vision—1287
Blueprint-Bench 2—27.3%
Furniture Assembly—22.5%
LMArena Document—1452

Multilingual Not comparable

Devstral 2: —, Grok 4.5: 54.5 (#43)

BenchmarkDevstral 2Grok 4.5
LMArena Non-English—1439
LMArena Chinese—1497
LMArena French—1458
LMArena German—1448
LMArena Japanese—1425
LMArena Korean—1402
LMArena Russian—1447
LMArena Spanish—1452

Instruction Following Not comparable

Devstral 2: —, Grok 4.5: 76.3 (#45)

BenchmarkDevstral 2Grok 4.5
LMArena Instruction Following—1446

Long Context Not comparable

Devstral 2: —, Grok 4.5: 44.8 (#54)

BenchmarkDevstral 2Grok 4.5
LMArena Longer Query—1463

Writing & Preference Not comparable

Devstral 2: —, Grok 4.5: 65.9 (#40)

BenchmarkDevstral 2Grok 4.5
LMArena Text—1448
LMArena Creative Writing—1442
EQ-Bench Creative Writing—1579
LMArena Multi-Turn—1457

Frequently asked questions

Is Devstral 2 better than Grok 4.5?

Grok 4.5 has enough public results to be ranked (#22); Devstral 2 does not yet, so treat this comparison as directional.

Which is cheaper, Devstral 2 or Grok 4.5?

Devstral 2 is cheaper. It lists at $0.40 per million input tokens and $2 per million output tokens; Grok 4.5 lists at $2 and $6.

Is Devstral 2 or Grok 4.5 better for coding?

Grok 4.5 scores higher on coding benchmarks: 51.7 versus 33.0 in the Noometry coding category.

Which has the bigger context window?

Grok 4.5 does, with 500K tokens against 262K.

How many benchmarks do Devstral 2 and Grok 4.5 share?

1 benchmark has published results for both models. Devstral 2 has 2 scored results on Noometry and Grok 4.5 has 52.

Related comparisons

Go deeper