Noometry

Model comparison

Grok 4.20 Multi-Agent vs Nemotron 4 340b Instruct

Grok 4.20 Multi-Agent is the stronger model overall, scoring 46.2 to 35.9 on the Noometry Index.

Last verified . 17 shared benchmarks.

Grok 4.20 Multi-Agent xAI

46.2

Rank #65 Confirmed

Nemotron 4 340b Instruct NVIDIA

35.9

Rank #223 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Grok 4.20 Multi-Agent scores higher in 8 categories and Nemotron 4 340b Instruct in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Grok 4.20 Multi-Agent leads 64.0 to 42.7.
  • Nemotron 4 340b Instruct has downloadable open weights; the other is API-only.

Side by side

Grok 4.20 Multi-AgentNemotron 4 340b Instruct
ProviderxAINVIDIA
Noometry Index46.235.9
Released2026-03-092024-06-14
WeightsProprietaryOpen
Context window1M—
Max output30K—
Input $ / M tokens$1.25—
Output $ / M tokens$2.50—
Results tracked2017

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.0 (#92), Nemotron 4 340b Instruct: 35.2 (#228)

BenchmarkGrok 4.20 Multi-AgentNemotron 4 340b Instruct
LMArena Coding14571209

Agentic & Tool Use Not comparable

Grok 4.20 Multi-Agent: —, Nemotron 4 340b Instruct: —

BenchmarkGrok 4.20 Multi-AgentNemotron 4 340b Instruct
LMArena Search1204—

Reasoning Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.9 (#48), Nemotron 4 340b Instruct: 23.4 (#178)

BenchmarkGrok 4.20 Multi-AgentNemotron 4 340b Instruct
LMArena Hard Prompts14481202
NYT Connections (extended)89.6%—

Math Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 39.4 (#104), Nemotron 4 340b Instruct: 34.3 (#195)

BenchmarkGrok 4.20 Multi-AgentNemotron 4 340b Instruct
LMArena Math14421216

Knowledge Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 40.4 (#119), Nemotron 4 340b Instruct: 32.0 (#216)

BenchmarkGrok 4.20 Multi-AgentNemotron 4 340b Instruct
LMArena Expert14451171

Multimodal Not comparable

Grok 4.20 Multi-Agent: 40.5 (#48), Nemotron 4 340b Instruct: —

BenchmarkGrok 4.20 Multi-AgentNemotron 4 340b Instruct
LMArena Vision1259—

Multilingual Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 54.4 (#43), Nemotron 4 340b Instruct: 37.9 (#233)

BenchmarkGrok 4.20 Multi-AgentNemotron 4 340b Instruct
LMArena Non-English14401206
LMArena Chinese14751214
LMArena French14661197
LMArena German14561192
LMArena Japanese14051128
LMArena Korean14161148
LMArena Russian14571219
LMArena Spanish14471195

Instruction Following Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 74.8 (#84), Nemotron 4 340b Instruct: 63.1 (#232)

BenchmarkGrok 4.20 Multi-AgentNemotron 4 340b Instruct
LMArena Instruction Following14201203

Long Context Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 43.7 (#88), Nemotron 4 340b Instruct: 37.1 (#221)

BenchmarkGrok 4.20 Multi-AgentNemotron 4 340b Instruct
LMArena Longer Query14311225

Writing & Preference Grok 4.20 Multi-Agent leads

Grok 4.20 Multi-Agent: 64.0 (#59), Nemotron 4 340b Instruct: 42.7 (#233)

BenchmarkGrok 4.20 Multi-AgentNemotron 4 340b Instruct
LMArena Text14501225
LMArena Creative Writing14361203
LMArena Multi-Turn14521214

Frequently asked questions

Is Grok 4.20 Multi-Agent better than Nemotron 4 340b Instruct?

Grok 4.20 Multi-Agent is the stronger model overall, scoring 46.2 to 35.9 on the Noometry Index.

Is Grok 4.20 Multi-Agent or Nemotron 4 340b Instruct better for coding?

Grok 4.20 Multi-Agent scores higher on coding benchmarks: 43.0 versus 35.2 in the Noometry coding category.

How many benchmarks do Grok 4.20 Multi-Agent and Nemotron 4 340b Instruct share?

17 benchmarks have published results for both models. Grok 4.20 Multi-Agent has 20 scored results on Noometry and Nemotron 4 340b Instruct has 17.

Related comparisons

Go deeper