Noometry

Model comparison

Claude Instant vs Pixtral Large

Pixtral Large has enough public results to be ranked (#259); Claude Instant does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Claude Instant Anthropic

29.5

Unranked Sparse

Pixtral Large Mistral AI

32.2

Rank #259 Reported

Summary

  • Pixtral Large has downloadable open weights; the other is API-only.

Side by side

Claude InstantPixtral Large
ProviderAnthropicMistral AI
Noometry Index29.532.2
Released2023-08-092024-11-01
WeightsProprietaryOpen
Context window—128K
Max output—128K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked73

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude Instant: —, Pixtral Large: —

BenchmarkClaude InstantPixtral Large
HumanEval+50.6%—

Reasoning Pixtral Large leads

Claude Instant: 19.6, Pixtral Large: 21.7 (#218)

BenchmarkClaude InstantPixtral Large
EnigmaEval—0.8%
DTBench45.8%—
Epoch Capabilities Index120.28—

Math Not comparable

Claude Instant: —, Pixtral Large: —

BenchmarkClaude InstantPixtral Large
GSM8K86.7%—

Knowledge Not comparable

Claude Instant: —, Pixtral Large: —

BenchmarkClaude InstantPixtral Large
ARC (AI2) Challenge86.3%—
MMLU73.4%—
TriviaQA78.9%—

Multimodal Not comparable

Claude Instant: —, Pixtral Large: 30.6 (#111)

BenchmarkClaude InstantPixtral Large
LMArena Vision—1089

Writing & Preference Not comparable

Claude Instant: —, Pixtral Large: 32.9 (#278)

BenchmarkClaude InstantPixtral Large
EQ-Bench Creative Writing—988

Frequently asked questions

Is Claude Instant better than Pixtral Large?

Pixtral Large has enough public results to be ranked (#259); Claude Instant does not yet, so treat this comparison as directional.

How many benchmarks do Claude Instant and Pixtral Large share?

0 benchmarks have published results for both models. Claude Instant has 7 scored results on Noometry and Pixtral Large has 3.

Related comparisons

Go deeper