Noometry

Model comparison

Claude Instant vs Mistral Small

Mistral Small has enough public results to be ranked (#243); Claude Instant does not yet, so treat this comparison as directional.

Last verified . 2 shared benchmarks.

Claude Instant Anthropic

29.5

Unranked Sparse

Mistral Small Mistral AI

33.4

Rank #243 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Claude Instant scores higher in 0 categories and Mistral Small in 1 category, but none of those gaps is larger than the uncertainty.
  • The biggest single-benchmark swing is DTBench: 45.8% for Claude Instant and 70.9% for Mistral Small.
  • Mistral Small has downloadable open weights; the other is API-only.

Side by side

Claude InstantMistral Small
ProviderAnthropicMistral AI
Noometry Index29.533.4
Released2023-08-092024-02-26
WeightsProprietaryOpen
Context window—262K
Max output—256K
Input $ / M tokens—$0.15
Output $ / M tokens—$0.60
Results tracked739

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude Instant: —, Mistral Small: 34.0 (#247)

BenchmarkClaude InstantMistral Small
SciCode—26.5%
BigCodeBench Instruct—36.1%
LiveBench Coding—36.2%
LMArena Coding—1362
BigCodeBench Complete—46.6%
ALE-Bench—497.62
HumanEval+50.6%—

Agentic & Tool Use Not comparable

Claude Instant: —, Mistral Small: 28.1 (#93)

BenchmarkClaude InstantMistral Small
Berkeley Function Calling Leaderboard—37.1%

Reasoning Too close to call

Claude Instant: 19.6, Mistral Small: 19.8 (#250)

BenchmarkClaude InstantMistral Small
DTBench45.8%70.9%
Kagi LLM Benchmark—37.8%
CritPt—0%
LiveBench Reasoning—44.8%
LMArena Hard Prompts—1335
LiveBench Data Analysis—53.7%
LMCA—20.6%
Epoch Capabilities Index120.28—
LiveBench—44%

Math Not comparable

Claude Instant: —, Mistral Small: 16.4 (#293)

BenchmarkClaude InstantMistral Small
OTIS Mock AIME 2024-2025—5.8%
LiveBench Math—39.9%
LMArena Math—1341
MATH Level 5—46.8%
GSM8K86.7%—

Knowledge Not comparable

Claude Instant: —, Mistral Small: 31.0 (#222)

BenchmarkClaude InstantMistral Small
MMLU73.4%68.7%
GPQA Diamond—47.5%
Vectara Hallucination Rate—5.1%
LMArena Expert—1291
ARC (AI2) Challenge86.3%—
TriviaQA78.9%—

Multimodal Not comparable

Claude Instant: —, Mistral Small: 33.5 (#96)

BenchmarkClaude InstantMistral Small
LMArena Vision—1142

Multilingual Not comparable

Claude Instant: —, Mistral Small: 45.5 (#169)

BenchmarkClaude InstantMistral Small
LMArena Non-English—1315
LMArena Chinese—1340
LMArena French—1337
LMArena German—1340
LMArena Japanese—1275
LMArena Korean—1259
LMArena Russian—1324
LMArena Spanish—1346

Instruction Following Not comparable

Claude Instant: —, Mistral Small: 66.4 (#209)

BenchmarkClaude InstantMistral Small
LiveBench Instruction Following—63.7%
LMArena Instruction Following—1310

Long Context Not comparable

Claude Instant: —, Mistral Small: 40.4 (#156)

BenchmarkClaude InstantMistral Small
LMArena Longer Query—1327

Writing & Preference Not comparable

Claude Instant: —, Mistral Small: 52.5 (#171)

BenchmarkClaude InstantMistral Small
LMArena Text—1338
LMArena Creative Writing—1305
LMArena Multi-Turn—1344
LiveBench Language—30.5%

Frequently asked questions

Is Claude Instant better than Mistral Small?

Mistral Small has enough public results to be ranked (#243); Claude Instant does not yet, so treat this comparison as directional.

How many benchmarks do Claude Instant and Mistral Small share?

2 benchmarks have published results for both models. Claude Instant has 7 scored results on Noometry and Mistral Small has 39.

Related comparisons

Go deeper