Noometry

Model comparison

Llama 3.1 Nemotron 70b Instruct vs Yi-1.5-34B

Llama 3.1 Nemotron 70b Instruct is the stronger model overall, scoring 37.6 to 30.6 on the Noometry Index.

Last verified . 14 shared benchmarks.

Llama 3.1 Nemotron 70b Instruct NVIDIA

37.6

Rank #203 Confirmed

Yi-1.5-34B 01.AI

30.6

Rank #289 Confirmed

Summary

  • They share 14 benchmarks with published results for both. Llama 3.1 Nemotron 70b Instruct scores higher in 8 categories and Yi-1.5-34B in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Llama 3.1 Nemotron 70b Instruct leads 34.1 to 14.8.

Side by side

Llama 3.1 Nemotron 70b InstructYi-1.5-34B
ProviderNVIDIA01.AI
Noometry Index37.630.6
Released2024-12-182024-05-13
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked1421

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Llama 3.1 Nemotron 70b Instruct leads

Llama 3.1 Nemotron 70b Instruct: 35.9 (#216), Yi-1.5-34B: 32.4 (#272)

BenchmarkLlama 3.1 Nemotron 70b InstructYi-1.5-34B
BigCodeBench Instruct38.7%33.9%
LMArena Coding12721169
BigCodeBench Complete48.2%43.8%

Reasoning Llama 3.1 Nemotron 70b Instruct leads

Llama 3.1 Nemotron 70b Instruct: 25.0 (#152), Yi-1.5-34B: 22.5 (#191)

BenchmarkLlama 3.1 Nemotron 70b InstructYi-1.5-34B
LMArena Hard Prompts12661160

Math Llama 3.1 Nemotron 70b Instruct leads

Llama 3.1 Nemotron 70b Instruct: 35.5 (#182), Yi-1.5-34B: 27.5 (#249)

BenchmarkLlama 3.1 Nemotron 70b InstructYi-1.5-34B
LMArena Math12711182
MATH Level 5—25.5%

Knowledge Llama 3.1 Nemotron 70b Instruct leads

Llama 3.1 Nemotron 70b Instruct: 34.1 (#199), Yi-1.5-34B: 14.8 (#295)

BenchmarkLlama 3.1 Nemotron 70b InstructYi-1.5-34B
LMArena Expert12421144
GPQA Diamond—32%

Multilingual Llama 3.1 Nemotron 70b Instruct leads

Llama 3.1 Nemotron 70b Instruct: 40.5 (#217), Yi-1.5-34B: 32.3 (#256)

BenchmarkLlama 3.1 Nemotron 70b InstructYi-1.5-34B
LMArena Non-English12451121
LMArena Chinese12631213
LMArena Russian12271091
LMArena French—1156
LMArena German—1111
LMArena Japanese—1021
LMArena Korean—1005
LMArena Spanish—1121

Instruction Following Llama 3.1 Nemotron 70b Instruct leads

Llama 3.1 Nemotron 70b Instruct: 65.9 (#213), Yi-1.5-34B: 59.2 (#257)

BenchmarkLlama 3.1 Nemotron 70b InstructYi-1.5-34B
LMArena Instruction Following12521139

Long Context Llama 3.1 Nemotron 70b Instruct leads

Llama 3.1 Nemotron 70b Instruct: 37.6 (#215), Yi-1.5-34B: 34.6 (#248)

BenchmarkLlama 3.1 Nemotron 70b InstructYi-1.5-34B
LMArena Longer Query12381143

Writing & Preference Llama 3.1 Nemotron 70b Instruct leads

Llama 3.1 Nemotron 70b Instruct: 48.4 (#203), Yi-1.5-34B: 37.4 (#257)

BenchmarkLlama 3.1 Nemotron 70b InstructYi-1.5-34B
LMArena Text12831173
LMArena Creative Writing12691135
LMArena Multi-Turn12751153

Frequently asked questions

Is Llama 3.1 Nemotron 70b Instruct better than Yi-1.5-34B?

Llama 3.1 Nemotron 70b Instruct is the stronger model overall, scoring 37.6 to 30.6 on the Noometry Index.

Is Llama 3.1 Nemotron 70b Instruct or Yi-1.5-34B better for coding?

Llama 3.1 Nemotron 70b Instruct scores higher on coding benchmarks: 35.9 versus 32.4 in the Noometry coding category.

How many benchmarks do Llama 3.1 Nemotron 70b Instruct and Yi-1.5-34B share?

14 benchmarks have published results for both models. Llama 3.1 Nemotron 70b Instruct has 14 scored results on Noometry and Yi-1.5-34B has 21.

Related comparisons

Go deeper