Model comparison

INTELLECT-1 vs Pixtral Large

Pixtral Large has enough public results to be ranked (#257); INTELLECT-1 does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Pixtral Large Mistral AI

31.7

Rank #257 Reported

Summary

  • Pixtral Large has downloadable open weights; the other is API-only.

Side by side

INTELLECT-1 and Pixtral Large specifications
INTELLECT-1Pixtral Large
ProviderHugging FaceMistral AI
Noometry Index—31.7
Released2024-11-292024-11-01
WeightsProprietaryOpen
Context window—128K
Max output—128K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked73

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Reasoning Not comparable

INTELLECT-1: —, Pixtral Large: 20.9 (#208)

Reasoning benchmarks
BenchmarkINTELLECT-1Pixtral Large
EnigmaEval—0.8%
BIG-Bench Hard34.9%—
Epoch Capabilities Index100.38—
HellaSwag71.4%—
WinoGrande65.8%—

Math Not comparable

INTELLECT-1: —, Pixtral Large: —

Math benchmarks
BenchmarkINTELLECT-1Pixtral Large
GSM8K38.6%—

Knowledge Not comparable

INTELLECT-1: —, Pixtral Large: —

Knowledge benchmarks
BenchmarkINTELLECT-1Pixtral Large
ARC (AI2) Challenge54.5%—
MMLU49.9%—

Multimodal Not comparable

INTELLECT-1: —, Pixtral Large: 30.0 (#105)

Multimodal benchmarks
BenchmarkINTELLECT-1Pixtral Large
LMArena Vision—1089

Writing & Preference Not comparable

INTELLECT-1: —, Pixtral Large: 32.9 (#273)

Writing & Preference benchmarks
BenchmarkINTELLECT-1Pixtral Large
EQ-Bench Creative Writing—988

Frequently asked questions

Is INTELLECT-1 better than Pixtral Large?

Pixtral Large has enough public results to be ranked (#257); INTELLECT-1 does not yet, so treat this comparison as directional.

How many benchmarks do INTELLECT-1 and Pixtral Large share?

0 benchmarks have published results for both models. INTELLECT-1 has 7 scored results on Noometry and Pixtral Large has 3.

Related comparisons

Go deeper