Model comparison

Nemotron-4 15B vs Pixtral Large

Pixtral Large has enough public results to be ranked (#259); Nemotron-4 15B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Nemotron-4 15B NVIDIA

—

Unranked

Pixtral Large Mistral AI

32.2

Rank #259 Reported

Summary

  • Pixtral Large has downloadable open weights; the other is API-only.

Side by side

Nemotron-4 15B and Pixtral Large specifications
Nemotron-4 15BPixtral Large
ProviderNVIDIAMistral AI
Noometry Index—32.2
Released2024-02-262024-11-01
WeightsProprietaryOpen
Context window—128K
Max output—128K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked83

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Reasoning Not comparable

Nemotron-4 15B: —, Pixtral Large: 21.7 (#218)

Reasoning benchmarks
BenchmarkNemotron-4 15BPixtral Large
EnigmaEval—0.8%
BIG-Bench Hard58.7%—
Epoch Capabilities Index107.72—
HellaSwag82.4%—
PIQA82.4%—
WinoGrande78%—

Math Not comparable

Nemotron-4 15B: —, Pixtral Large: —

Math benchmarks
BenchmarkNemotron-4 15BPixtral Large
GSM8K46%—

Knowledge Not comparable

Nemotron-4 15B: —, Pixtral Large: —

Knowledge benchmarks
BenchmarkNemotron-4 15BPixtral Large
ARC (AI2) Challenge55.5%—
MMLU58.7%—

Multimodal Not comparable

Nemotron-4 15B: —, Pixtral Large: 30.6 (#111)

Multimodal benchmarks
BenchmarkNemotron-4 15BPixtral Large
LMArena Vision—1089

Writing & Preference Not comparable

Nemotron-4 15B: —, Pixtral Large: 32.9 (#278)

Writing & Preference benchmarks
BenchmarkNemotron-4 15BPixtral Large
EQ-Bench Creative Writing—988

Frequently asked questions

Is Nemotron-4 15B better than Pixtral Large?

Pixtral Large has enough public results to be ranked (#259); Nemotron-4 15B does not yet, so treat this comparison as directional.

How many benchmarks do Nemotron-4 15B and Pixtral Large share?

0 benchmarks have published results for both models. Nemotron-4 15B has 8 scored results on Noometry and Pixtral Large has 3.

Related comparisons

Go deeper