Model comparison

Nemotron 4 340b Instruct vs Trinity Large Thinking

Trinity Large Thinking is the stronger model overall, scoring 38.6 to 35.9 on the Noometry Index.

Last verified . 17 shared benchmarks.

Nemotron 4 340b Instruct NVIDIA

35.9

Rank #223 Confirmed

Trinity Large Thinking Arcee AI

38.6

Rank #185 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Nemotron 4 340b Instruct scores higher in 2 categories and Trinity Large Thinking in 6 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Trinity Large Thinking leads 53.8 to 42.7.

Side by side

Nemotron 4 340b Instruct and Trinity Large Thinking specifications
Nemotron 4 340b InstructTrinity Large Thinking
ProviderNVIDIAArcee AI
Noometry Index35.938.6
Released2024-06-142026-04-01
WeightsOpenOpen
Context window—262K
Max output—80K
Input $ / M tokens—$0.25
Output $ / M tokens—$0.80
Results tracked1724

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nemotron 4 340b Instruct leads

Nemotron 4 340b Instruct: 35.2 (#228), Trinity Large Thinking: 34.1 (#244)

Coding benchmarks
BenchmarkNemotron 4 340b InstructTrinity Large Thinking
LMArena Coding12091381
LMArena WebDev—1238
SciCode—36.1%

Reasoning Nemotron 4 340b Instruct leads

Nemotron 4 340b Instruct: 23.4 (#178), Trinity Large Thinking: 16.9 (#298)

Reasoning benchmarks
BenchmarkNemotron 4 340b InstructTrinity Large Thinking
LMArena Hard Prompts12021350
NYT Connections (extended)—16.5%
CritPt—0.9%
Thematic Generalization—41.6%
Surface Evolver Bench—15.6%

Math Trinity Large Thinking leads

Nemotron 4 340b Instruct: 34.3 (#195), Trinity Large Thinking: 37.6 (#149)

Math benchmarks
BenchmarkNemotron 4 340b InstructTrinity Large Thinking
LMArena Math12161366

Knowledge Trinity Large Thinking leads

Nemotron 4 340b Instruct: 32.0 (#216), Trinity Large Thinking: 40.9 (#113)

Knowledge benchmarks
BenchmarkNemotron 4 340b InstructTrinity Large Thinking
LMArena Expert11711360
Vectara Hallucination Rate—6.9%

Multilingual Trinity Large Thinking leads

Nemotron 4 340b Instruct: 37.9 (#233), Trinity Large Thinking: 46.2 (#160)

Multilingual benchmarks
BenchmarkNemotron 4 340b InstructTrinity Large Thinking
LMArena Non-English12061325
LMArena Chinese12141373
LMArena French11971374
LMArena German11921356
LMArena Japanese11281311
LMArena Korean11481306
LMArena Russian12191337
LMArena Spanish11951357

Instruction Following Trinity Large Thinking leads

Nemotron 4 340b Instruct: 63.1 (#232), Trinity Large Thinking: 70.5 (#162)

Instruction Following benchmarks
BenchmarkNemotron 4 340b InstructTrinity Large Thinking
LMArena Instruction Following12031334

Long Context Trinity Large Thinking leads

Nemotron 4 340b Instruct: 37.1 (#221), Trinity Large Thinking: 41.3 (#144)

Long Context benchmarks
BenchmarkNemotron 4 340b InstructTrinity Large Thinking
LMArena Longer Query12251355

Writing & Preference Trinity Large Thinking leads

Nemotron 4 340b Instruct: 42.7 (#233), Trinity Large Thinking: 53.8 (#158)

Writing & Preference benchmarks
BenchmarkNemotron 4 340b InstructTrinity Large Thinking
LMArena Text12251340
LMArena Creative Writing12031320
LMArena Multi-Turn12141342

Frequently asked questions

Is Nemotron 4 340b Instruct better than Trinity Large Thinking?

Trinity Large Thinking is the stronger model overall, scoring 38.6 to 35.9 on the Noometry Index.

Is Nemotron 4 340b Instruct or Trinity Large Thinking better for coding?

Nemotron 4 340b Instruct scores higher on coding benchmarks: 35.2 versus 34.1 in the Noometry coding category.

How many benchmarks do Nemotron 4 340b Instruct and Trinity Large Thinking share?

17 benchmarks have published results for both models. Nemotron 4 340b Instruct has 17 scored results on Noometry and Trinity Large Thinking has 24.

Related comparisons

Go deeper