Model comparison

Nemotron 4 340b Instruct vs Sonar

Sonar is the stronger model overall, scoring 38.5 to 35.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Nemotron 4 340b Instruct NVIDIA

35.9

Rank #223 Confirmed

Sonar Perplexity

38.5

Rank #187 Confirmed

Summary

  • The widest gap is in writing & preference, where Sonar leads 52.6 to 42.7.
  • Nemotron 4 340b Instruct has downloadable open weights; the other is API-only.

Side by side

Nemotron 4 340b Instruct and Sonar specifications
Nemotron 4 340b InstructSonar
ProviderNVIDIAPerplexity
Noometry Index35.938.5
Released2024-06-142024-01-01
WeightsOpenProprietary
Context window—128K
Max output—4K
Input $ / M tokens—$1
Output $ / M tokens—$1
Results tracked177

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Nemotron 4 340b Instruct: 35.2 (#228), Sonar: 35.7 (#221)

Coding benchmarks
BenchmarkNemotron 4 340b InstructSonar
LiveBench Coding—35.1%
LMArena Coding1209—

Reasoning Nemotron 4 340b Instruct leads

Nemotron 4 340b Instruct: 23.4 (#178), Sonar: 21.1 (#227)

Reasoning benchmarks
BenchmarkNemotron 4 340b InstructSonar
LiveBench Reasoning—46.3%
LMArena Hard Prompts1202—
LiveBench Data Analysis—37.9%
LiveBench—46.9%

Math Too close to call

Nemotron 4 340b Instruct: 34.3 (#195), Sonar: 33.7 (#200)

Math benchmarks
BenchmarkNemotron 4 340b InstructSonar
LiveBench Math—41.6%
LMArena Math1216—

Knowledge Not comparable

Nemotron 4 340b Instruct: 32.0 (#216), Sonar: —

Knowledge benchmarks
BenchmarkNemotron 4 340b InstructSonar
LMArena Expert1171—

Multilingual Not comparable

Nemotron 4 340b Instruct: 37.9 (#233), Sonar: —

Multilingual benchmarks
BenchmarkNemotron 4 340b InstructSonar
LMArena Non-English1206—
LMArena Chinese1214—
LMArena French1197—
LMArena German1192—
LMArena Japanese1128—
LMArena Korean1148—
LMArena Russian1219—
LMArena Spanish1195—

Instruction Following Sonar leads

Nemotron 4 340b Instruct: 63.1 (#232), Sonar: 71.4 (#150)

Instruction Following benchmarks
BenchmarkNemotron 4 340b InstructSonar
LiveBench Instruction Following—76.2%
LMArena Instruction Following1203—

Long Context Not comparable

Nemotron 4 340b Instruct: 37.1 (#221), Sonar: —

Long Context benchmarks
BenchmarkNemotron 4 340b InstructSonar
LMArena Longer Query1225—

Writing & Preference Sonar leads

Nemotron 4 340b Instruct: 42.7 (#233), Sonar: 52.6 (#167)

Writing & Preference benchmarks
BenchmarkNemotron 4 340b InstructSonar
LMArena Text1225—
LMArena Creative Writing1203—
LMArena Multi-Turn1214—
LiveBench Language—44.1%

Frequently asked questions

Is Nemotron 4 340b Instruct better than Sonar?

Sonar is the stronger model overall, scoring 38.5 to 35.9 on the Noometry Index.

Is Nemotron 4 340b Instruct or Sonar better for coding?

They score almost the same on coding (35.2 vs 35.7); test both on your own repository before choosing.

How many benchmarks do Nemotron 4 340b Instruct and Sonar share?

0 benchmarks have published results for both models. Nemotron 4 340b Instruct has 17 scored results on Noometry and Sonar has 7.

Related comparisons

Go deeper