Noometry

Model comparison

Claude Instant vs Mistral Large

Mistral Large has enough public results to be ranked (#263); Claude Instant does not yet, so treat this comparison as directional.

Last verified . 4 shared benchmarks.

Claude Instant Anthropic

29.5

Unranked Sparse

Mistral Large Mistral AI

31.9

Rank #263 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Claude Instant scores higher in 1 category and Mistral Large in 0 categories; one gap is clear of the uncertainty.
  • The widest gap is in reasoning, where Claude Instant leads 19.6 to 15.8.
  • The biggest single-benchmark swing is DTBench: 45.8% for Claude Instant and 65.1% for Mistral Large.
  • Mistral Large has downloadable open weights; the other is API-only.

Side by side

Claude InstantMistral Large
ProviderAnthropicMistral AI
Noometry Index29.531.9
Released2023-08-092024-02-26
WeightsProprietaryOpen
Context window—131K
Max output—16K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked751

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude Instant: —, Mistral Large: 34.3 (#240)

BenchmarkClaude InstantMistral Large
HumanEval+50.6%62.2%
SciCode—36.2%
BigCodeBench Instruct—30%
LiveBench Coding—47.1%
LMArena Coding—1277
BigCodeBench Complete—38.3%
ALE-Bench—264.7
MBPP+—59.5%

Agentic & Tool Use Not comparable

Claude Instant: —, Mistral Large: 28.6 (#89)

BenchmarkClaude InstantMistral Large
Berkeley Function Calling Leaderboard—38.4%

Reasoning Claude Instant leads

Claude Instant: 19.6, Mistral Large: 15.8 (#310)

BenchmarkClaude InstantMistral Large
DTBench45.8%65.1%
Epoch Capabilities Index120.28128.52
SimpleBench—22.5%
CritPt—0%
LiveBench Reasoning—43.5%
LMArena Hard Prompts—1257
LiveBench Data Analysis—50.1%
LMCA—16.7%
ForecastBench—57.1
LiveBench—48.4%

Math Not comparable

Claude Instant: —, Mistral Large: 18.2 (#291)

BenchmarkClaude InstantMistral Large
OTIS Mock AIME 2024-2025—8.5%
Omni-MATH—28.1%
LiveBench Math—42.5%
LMArena Math—1262
MATH Level 5—50.3%
FrontierMath (Feb 2025 set)—0.3%
GSM8K86.7%—

Knowledge Not comparable

Claude Instant: —, Mistral Large: 30.1 (#230)

BenchmarkClaude InstantMistral Large
MMLU73.4%80%
GPQA Diamond—51.3%
MMLU-Pro—59.9%
Confabulations—21.4%
Vectara Hallucination Rate—4.5%
GPQA (HELM)—43.5%
LMArena Expert—1232
ARC (AI2) Challenge86.3%—
TriviaQA78.9%—

Multilingual Not comparable

Claude Instant: —, Mistral Large: 40.0 (#219)

BenchmarkClaude InstantMistral Large
LMArena Non-English—1237
LMArena Chinese—1240
LMArena French—1325
LMArena German—1254
LMArena Japanese—1188
LMArena Korean—1202
LMArena Russian—1257
LMArena Spanish—1268

Instruction Following Not comparable

Claude Instant: —, Mistral Large: 67.9 (#191)

BenchmarkClaude InstantMistral Large
LiveBench Instruction Following—67.9%
IFEval—87.7%
LMArena Instruction Following—1249

Long Context Not comparable

Claude Instant: —, Mistral Large: 38.3 (#199)

BenchmarkClaude InstantMistral Large
LMArena Longer Query—1261

Writing & Preference Not comparable

Claude Instant: —, Mistral Large: 40.7 (#242)

BenchmarkClaude InstantMistral Large
LMArena Text—1266
LMArena Creative Writing—1243
Short-Story Creative Writing—69%
EQ-Bench Creative Writing—985
WildBench—80.1%
LMArena Multi-Turn—1260
LiveBench Language—39.4%

Frequently asked questions

Is Claude Instant better than Mistral Large?

Mistral Large has enough public results to be ranked (#263); Claude Instant does not yet, so treat this comparison as directional.

How many benchmarks do Claude Instant and Mistral Large share?

4 benchmarks have published results for both models. Claude Instant has 7 scored results on Noometry and Mistral Large has 51.

Related comparisons

Go deeper