Noometry

Model comparison

Nemotron 4 340b Instruct vs Qwen2.5 72B Instruct

Nemotron 4 340b Instruct is the stronger model overall, scoring 35.3 to 31.5 on the Noometry Index.

Last verified . 17 shared benchmarks.

Nemotron 4 340b Instruct NVIDIA

35.3

Rank #218 Confirmed

Qwen2.5 72B Instruct Alibaba (Qwen)

31.5

Rank #259 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Nemotron 4 340b Instruct scores higher in 4 categories and Qwen2.5 72B Instruct in 4 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Nemotron 4 340b Instruct leads 31.7 to 18.1.

Side by side

Nemotron 4 340b InstructQwen2.5 72B Instruct
ProviderNVIDIAAlibaba (Qwen)
Noometry Index35.331.5
Released2024-06-142024-09
WeightsOpenOpen
Context window—131K
Max output—8K
Input $ / M tokens—$1.40
Output $ / M tokens—$5.60
Results tracked1743

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nemotron 4 340b Instruct leads

Nemotron 4 340b Instruct: 34.6 (#223), Qwen2.5 72B Instruct: 32.8 (#256)

BenchmarkNemotron 4 340b InstructQwen2.5 72B Instruct
LMArena Coding12091293
WeirdML—16%
BigCodeBench Instruct—45.8%
BigCodeBench Complete—55.9%

Agentic & Tool Use Not comparable

Nemotron 4 340b Instruct: —, Qwen2.5 72B Instruct: 22.0 (#124)

BenchmarkNemotron 4 340b InstructQwen2.5 72B Instruct
TheAgentCompany—5.7%
BALROG—16.2%
METR Time Horizons—35.8%

Reasoning Nemotron 4 340b Instruct leads

Nemotron 4 340b Instruct: 22.4 (#180), Qwen2.5 72B Instruct: 21.4 (#197)

BenchmarkNemotron 4 340b InstructQwen2.5 72B Instruct
LMArena Hard Prompts12021271
DTBench—62.9%
LMCA—13.4%
BIG-Bench Hard—79.8%
Epoch Capabilities Index—129.01
ForecastBench—57.5
HellaSwag—84.8%
PIQA—82.6%
WinoGrande—82.3%

Math Nemotron 4 340b Instruct leads

Nemotron 4 340b Instruct: 31.7 (#193), Qwen2.5 72B Instruct: 18.1 (#281)

BenchmarkNemotron 4 340b InstructQwen2.5 72B Instruct
LMArena Math12161283
OTIS Mock AIME 2024-2025—8.1%
Omni-MATH—33%
MATH Level 5—63.2%

Knowledge Nemotron 4 340b Instruct leads

Nemotron 4 340b Instruct: 31.4 (#212), Qwen2.5 72B Instruct: 26.9 (#247)

BenchmarkNemotron 4 340b InstructQwen2.5 72B Instruct
LMArena Expert11711245
GPQA Diamond—49.1%
MMLU-Pro—63.1%
Confabulations—19.1%
GPQA (HELM)—42.6%
ARC (AI2) Challenge—94.5%
MMLU—85.3%
TriviaQA—71.9%

Multilingual Qwen2.5 72B Instruct leads

Nemotron 4 340b Instruct: 38.0 (#228), Qwen2.5 72B Instruct: 41.2 (#208)

BenchmarkNemotron 4 340b InstructQwen2.5 72B Instruct
LMArena Non-English12061252
LMArena Chinese12141272
LMArena French11961279
LMArena German11921234
LMArena Japanese11281180
LMArena Korean11481188
LMArena Russian12191264
LMArena Spanish11951255

Instruction Following Qwen2.5 72B Instruct leads

Nemotron 4 340b Instruct: 63.3 (#227), Qwen2.5 72B Instruct: 65.7 (#216)

BenchmarkNemotron 4 340b InstructQwen2.5 72B Instruct
LMArena Instruction Following12031254
IFEval—80.6%

Long Context Qwen2.5 72B Instruct leads

Nemotron 4 340b Instruct: 37.1 (#216), Qwen2.5 72B Instruct: 38.9 (#183)

BenchmarkNemotron 4 340b InstructQwen2.5 72B Instruct
LMArena Longer Query12251282

Writing & Preference Qwen2.5 72B Instruct leads

Nemotron 4 340b Instruct: 42.9 (#229), Qwen2.5 72B Instruct: 46.9 (#210)

BenchmarkNemotron 4 340b InstructQwen2.5 72B Instruct
LMArena Text12251269
LMArena Creative Writing12031221
LMArena Multi-Turn12141272
WildBench—80.2%

Frequently asked questions

Is Nemotron 4 340b Instruct better than Qwen2.5 72B Instruct?

Nemotron 4 340b Instruct is the stronger model overall, scoring 35.3 to 31.5 on the Noometry Index.

Is Nemotron 4 340b Instruct or Qwen2.5 72B Instruct better for coding?

Nemotron 4 340b Instruct scores higher on coding benchmarks: 34.6 versus 32.8 in the Noometry coding category.

How many benchmarks do Nemotron 4 340b Instruct and Qwen2.5 72B Instruct share?

17 benchmarks have published results for both models. Nemotron 4 340b Instruct has 17 scored results on Noometry and Qwen2.5 72B Instruct has 43.

Related comparisons

Go deeper