Noometry

Model comparison

Claude Sonnet 4 vs Mistral Small 3.2

Claude Sonnet 4 is the stronger model overall, scoring 40.6 to 30.8 on the Noometry Index. Mistral Small 3.2 costs 45× less per token, which makes it the better buy when Claude Sonnet 4's lead doesn't matter for your workload.

Last verified . 5 shared benchmarks.

Claude Sonnet 4 Anthropic

40.6

Rank #139 Confirmed

Mistral Small 3.2 Mistral AI

30.8

Rank #271 Confirmed

Summary

  • They share 5 benchmarks with published results for both. Claude Sonnet 4 scores higher in 4 categories and Mistral Small 3.2 in 0 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where Claude Sonnet 4 leads 41.5 to 24.9.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 71.1% for Claude Sonnet 4 and 30.3% for Mistral Small 3.2.
  • Mistral Small 3.2 is cheaper at $0.0938 / $0.25 per million input/output tokens, against $3 / $15 for Claude Sonnet 4.
  • Mistral Small 3.2 accepts more context: 256K tokens versus 200K.
  • Mistral Small 3.2 has downloadable open weights; the other is API-only.

Side by side

Claude Sonnet 4Mistral Small 3.2
ProviderAnthropicMistral AI
Noometry Index40.630.8
Released2025-05-222025-06-20
WeightsProprietaryOpen
Context window200K256K
Max output64K16K
Input $ / M tokens$3$0.0938
Output $ / M tokens$15$0.25
Results tracked586

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude Sonnet 4: 44.0 (#70), Mistral Small 3.2: —

BenchmarkClaude Sonnet 4Mistral Small 3.2
SWE-bench Verified (bash only)64.9%—
Aider Polyglot61.3%—
SciCode40%—
GSO4.9%—
WeirdML46.1%—
LMArena Coding1414—
ALE-Bench655.35—

Agentic & Tool Use Not comparable

Claude Sonnet 4: 38.3 (#29), Mistral Small 3.2: —

BenchmarkClaude Sonnet 4Mistral Small 3.2
TheAgentCompany33.1%—
Cybench35%—
DeepResearch Bench46.6%—
OSWorld43.9%—
METR Time Horizons62%—

Reasoning Claude Sonnet 4 leads

Claude Sonnet 4: 23.0 (#169), Mistral Small 3.2: 17.5 (#282)

BenchmarkClaude Sonnet 4Mistral Small 3.2
Kagi LLM Benchmark73%40.4%
Epoch Capabilities Index141.69131.73
ARC-AGI-25.9%—
SimpleBench45.5%—
ARC-AGI-140%—
CritPt0.3%—
Chess Puzzles—1%
EnigmaEval3.1%—
LMArena Hard Prompts1372—
DTBench77.1%—
LMCA29%—
ForecastBench60.2—

Math Claude Sonnet 4 leads

Claude Sonnet 4: 41.5 (#71), Mistral Small 3.2: 24.9 (#251)

BenchmarkClaude Sonnet 4Mistral Small 3.2
OTIS Mock AIME 2024-202571.1%30.3%
Omni-MATH60.2%—
LMArena Math1375—
MATH Level 584.4%—
FrontierMath (Feb 2025 set)4.1%—
FrontierMath Tier 4 (v1)0%—

Knowledge Claude Sonnet 4 leads

Claude Sonnet 4: 41.6 (#99), Mistral Small 3.2: 26.8 (#249)

BenchmarkClaude Sonnet 4Mistral Small 3.2
GPQA Diamond79.2%49.1%
Humanity's Last Exam7.8%—
MMLU-Pro84.3%—
Confabulations13.2%—
Vectara Hallucination Rate10.3%—
GPQA (HELM)70.6%—
LMArena Expert1371—

Multimodal Not comparable

Claude Sonnet 4: 25.6 (#116), Mistral Small 3.2: —

BenchmarkClaude Sonnet 4Mistral Small 3.2
LMArena Vision1191—
GeoBench37%—
VPCT34%—
MindCube44.8%—

Multilingual Not comparable

Claude Sonnet 4: 46.9 (#151), Mistral Small 3.2: —

BenchmarkClaude Sonnet 4Mistral Small 3.2
LMArena Non-English1333—
LMArena Chinese1351—
LMArena French1364—
LMArena German1331—
LMArena Japanese1301—
LMArena Korean1293—
LMArena Russian1355—
LMArena Spanish1356—

Instruction Following Not comparable

Claude Sonnet 4: 71.8 (#141), Mistral Small 3.2: —

BenchmarkClaude Sonnet 4Mistral Small 3.2
IFEval84%—
LMArena Instruction Following1375—

Long Context Not comparable

Claude Sonnet 4: 33.6 (#254), Mistral Small 3.2: —

BenchmarkClaude Sonnet 4Mistral Small 3.2
Fiction.LiveBench46.9%—
LMArena Longer Query1398—

Writing & Preference Claude Sonnet 4 leads

Claude Sonnet 4: 57.3 (#127), Mistral Small 3.2: 45.1 (#219)

BenchmarkClaude Sonnet 4Mistral Small 3.2
EQ-Bench Creative Writing14831255
LMArena Text1351—
LMArena Creative Writing1345—
Short-Story Creative Writing81.4%—
WildBench83.8%—
LMArena Multi-Turn1376—

Frequently asked questions

Is Claude Sonnet 4 better than Mistral Small 3.2?

Claude Sonnet 4 is the stronger model overall, scoring 40.6 to 30.8 on the Noometry Index. Mistral Small 3.2 costs 45× less per token, which makes it the better buy when Claude Sonnet 4's lead doesn't matter for your workload.

Which is cheaper, Claude Sonnet 4 or Mistral Small 3.2?

Mistral Small 3.2 is cheaper. It lists at $0.0938 per million input tokens and $0.25 per million output tokens; Claude Sonnet 4 lists at $3 and $15.

Which has the bigger context window?

Mistral Small 3.2 does, with 256K tokens against 200K.

How many benchmarks do Claude Sonnet 4 and Mistral Small 3.2 share?

5 benchmarks have published results for both models. Claude Sonnet 4 has 58 scored results on Noometry and Mistral Small 3.2 has 6.

Related comparisons

Go deeper