Noometry

Model comparison

Nemotron 4 340b Instruct vs Pixtral Large

Nemotron 4 340b Instruct is the stronger model overall, scoring 35.9 to 32.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Nemotron 4 340b Instruct NVIDIA

35.9

Rank #223 Confirmed

Pixtral Large Mistral AI

32.2

Rank #259 Reported

Summary

  • The widest gap is in writing & preference, where Nemotron 4 340b Instruct leads 42.7 to 32.9.

Side by side

Nemotron 4 340b InstructPixtral Large
ProviderNVIDIAMistral AI
Noometry Index35.932.2
Released2024-06-142024-11-01
WeightsOpenOpen
Context window—128K
Max output—128K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked173

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Nemotron 4 340b Instruct: 35.2 (#228), Pixtral Large: —

BenchmarkNemotron 4 340b InstructPixtral Large
LMArena Coding1209—

Reasoning Nemotron 4 340b Instruct leads

Nemotron 4 340b Instruct: 23.4 (#178), Pixtral Large: 21.7 (#218)

BenchmarkNemotron 4 340b InstructPixtral Large
EnigmaEval—0.8%
LMArena Hard Prompts1202—

Math Not comparable

Nemotron 4 340b Instruct: 34.3 (#195), Pixtral Large: —

BenchmarkNemotron 4 340b InstructPixtral Large
LMArena Math1216—

Knowledge Not comparable

Nemotron 4 340b Instruct: 32.0 (#216), Pixtral Large: —

BenchmarkNemotron 4 340b InstructPixtral Large
LMArena Expert1171—

Multimodal Not comparable

Nemotron 4 340b Instruct: —, Pixtral Large: 30.6 (#111)

BenchmarkNemotron 4 340b InstructPixtral Large
LMArena Vision—1089

Multilingual Not comparable

Nemotron 4 340b Instruct: 37.9 (#233), Pixtral Large: —

BenchmarkNemotron 4 340b InstructPixtral Large
LMArena Non-English1206—
LMArena Chinese1214—
LMArena French1197—
LMArena German1192—
LMArena Japanese1128—
LMArena Korean1148—
LMArena Russian1219—
LMArena Spanish1195—

Instruction Following Not comparable

Nemotron 4 340b Instruct: 63.1 (#232), Pixtral Large: —

BenchmarkNemotron 4 340b InstructPixtral Large
LMArena Instruction Following1203—

Long Context Not comparable

Nemotron 4 340b Instruct: 37.1 (#221), Pixtral Large: —

BenchmarkNemotron 4 340b InstructPixtral Large
LMArena Longer Query1225—

Writing & Preference Nemotron 4 340b Instruct leads

Nemotron 4 340b Instruct: 42.7 (#233), Pixtral Large: 32.9 (#278)

BenchmarkNemotron 4 340b InstructPixtral Large
LMArena Text1225—
LMArena Creative Writing1203—
EQ-Bench Creative Writing—988
LMArena Multi-Turn1214—

Frequently asked questions

Is Nemotron 4 340b Instruct better than Pixtral Large?

Nemotron 4 340b Instruct is the stronger model overall, scoring 35.9 to 32.2 on the Noometry Index.

How many benchmarks do Nemotron 4 340b Instruct and Pixtral Large share?

0 benchmarks have published results for both models. Nemotron 4 340b Instruct has 17 scored results on Noometry and Pixtral Large has 3.

Related comparisons

Go deeper