Model comparison

Devstral Medium vs Gemini 4 Argon

Gemini 4 Argon has enough public results to be ranked (#24); Devstral Medium does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Devstral Medium Mistral AI

30.1

Unranked Sparse

Gemini 4 Argon Google

56.5

Rank #24 Confirmed

Summary

  • They share 1 benchmark with published results for both. Devstral Medium scores higher in 0 categories and Gemini 4 Argon in 2 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Gemini 4 Argon leads 62.0 to 24.3.
  • Devstral Medium has downloadable open weights; the other is API-only.

Side by side

Devstral Medium and Gemini 4 Argon specifications
Devstral MediumGemini 4 Argon
ProviderMistral AIGoogle
Noometry Index30.156.5
Released2025-07-102026-09-30
WeightsOpenProprietary
Context window262K—
Max output262K—
Input $ / M tokens$0.40—
Output $ / M tokens$2—
Results tracked221

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 4 Argon leads

Devstral Medium: 24.3, Gemini 4 Argon: 62.0 (#9)

Coding benchmarks
BenchmarkDevstral MediumGemini 4 Argon
LMArena WebDev10761678
FrontierSWE—55%
SciCode—61.8%
LMArena Coding—1550

Agentic & Tool Use Not comparable

Devstral Medium: —, Gemini 4 Argon: 49.2 (#8)

Agentic & Tool Use benchmarks
BenchmarkDevstral MediumGemini 4 Argon
APEX-Agents—82.2%
Vending-Bench 2—13,718

Reasoning Gemini 4 Argon leads

Devstral Medium: 21.1, Gemini 4 Argon: 44.2 (#47)

Reasoning benchmarks
BenchmarkDevstral MediumGemini 4 Argon
Kagi LLM Benchmark37.7%—
CritPt—27.1%
LMArena Hard Prompts—1548

Math Not comparable

Devstral Medium: —, Gemini 4 Argon: 73.9 (#17)

Math benchmarks
BenchmarkDevstral MediumGemini 4 Argon
ProofBench—99%
LMArena Math—1536

Knowledge Not comparable

Devstral Medium: —, Gemini 4 Argon: 43.9 (#89)

Knowledge benchmarks
BenchmarkDevstral MediumGemini 4 Argon
LMArena Expert—1553

Multimodal Not comparable

Devstral Medium: —, Gemini 4 Argon: 46.5 (#14)

Multimodal benchmarks
BenchmarkDevstral MediumGemini 4 Argon
Blueprint-Bench 2—54.4%

Multilingual Not comparable

Devstral Medium: —, Gemini 4 Argon: 60.3 (#1)

Multilingual benchmarks
BenchmarkDevstral MediumGemini 4 Argon
LMArena Non-English—1523
LMArena Chinese—1610
LMArena Russian—1537
LMArena Spanish—1497

Instruction Following Not comparable

Devstral Medium: —, Gemini 4 Argon: 80.1 (#2)

Instruction Following benchmarks
BenchmarkDevstral MediumGemini 4 Argon
LMArena Instruction Following—1538

Long Context Not comparable

Devstral Medium: —, Gemini 4 Argon: 47.6 (#15)

Long Context benchmarks
BenchmarkDevstral MediumGemini 4 Argon
LMArena Longer Query—1549

Writing & Preference Not comparable

Devstral Medium: —, Gemini 4 Argon: 71.4 (#19)

Writing & Preference benchmarks
BenchmarkDevstral MediumGemini 4 Argon
LMArena Text—1534
LMArena Creative Writing—1531
LMArena Multi-Turn—1557

Frequently asked questions

Is Devstral Medium better than Gemini 4 Argon?

Gemini 4 Argon has enough public results to be ranked (#24); Devstral Medium does not yet, so treat this comparison as directional.

Is Devstral Medium or Gemini 4 Argon better for coding?

Gemini 4 Argon scores higher on coding benchmarks: 62.0 versus 24.3 in the Noometry coding category.

How many benchmarks do Devstral Medium and Gemini 4 Argon share?

1 benchmark has published results for both models. Devstral Medium has 2 scored results on Noometry and Gemini 4 Argon has 21.

Related comparisons

Go deeper