Model comparison

Gemma 2 9B vs Nemotron 3 Super

Nemotron 3 Super is the stronger model overall, scoring 40.1 to 25.9 on the Noometry Index.

Last verified . 15 shared benchmarks.

Gemma 2 9B Google

25.9

Rank #341 Confirmed

Nemotron 3 Super NVIDIA

40.1

Rank #153 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Gemma 2 9B scores higher in 0 categories and Nemotron 3 Super in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Nemotron 3 Super leads 39.6 to 9.9.

Side by side

Gemma 2 9B and Nemotron 3 Super specifications
Gemma 2 9BNemotron 3 Super
ProviderGoogleNVIDIA
Noometry Index25.940.1
Released2024-06-242026-03-11
WeightsOpenOpen
Context window—262K
Max output—131K
Input $ / M tokens—$0.08
Output $ / M tokens—$0.45
Results tracked3521

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nemotron 3 Super leads

Gemma 2 9B: 29.4 (#304), Nemotron 3 Super: 39.4 (#158)

Coding benchmarks
BenchmarkGemma 2 9BNemotron 3 Super
LMArena Coding11731403
SciCode—36%
WeirdML—38%
BigCodeBench Instruct34.7%—
LiveBench Coding22.5%—
BigCodeBench Complete40.6%—
ALE-Bench—213.9

Reasoning Nemotron 3 Super leads

Gemma 2 9B: 15.9 (#309), Nemotron 3 Super: 18.7 (#276)

Reasoning benchmarks
BenchmarkGemma 2 9BNemotron 3 Super
LMArena Hard Prompts11711386
NYT Connections (extended)—15.4%
CritPt—3.1%
LiveBench Reasoning15.2%—
LiveBench Data Analysis36.4%—
Epoch Capabilities Index119.83—
LiveBench28.7%—
PIQA83.7%—

Math Nemotron 3 Super leads

Gemma 2 9B: 9.9 (#318), Nemotron 3 Super: 39.6 (#101)

Math benchmarks
BenchmarkGemma 2 9BNemotron 3 Super
LMArena Math11831380
MathArena Final-Answer Competitions—60.4%
OTIS Mock AIME 2024-20250.6%—
LiveBench Math19.8%—
MATH Level 521%—
GSM8K84.9%—

Knowledge Nemotron 3 Super leads

Gemma 2 9B: 9.7 (#305), Nemotron 3 Super: 38.9 (#139)

Knowledge benchmarks
BenchmarkGemma 2 9BNemotron 3 Super
LMArena Expert11471398
GPQA Diamond27.5%—
BoolQ85.7%—
MMLU72.1%—

Multilingual Nemotron 3 Super leads

Gemma 2 9B: 36.6 (#238), Nemotron 3 Super: 48.4 (#144)

Multilingual benchmarks
BenchmarkGemma 2 9BNemotron 3 Super
LMArena Non-English11881355
LMArena Chinese11851432
LMArena French11901405
LMArena German11861341
LMArena Russian12001336
LMArena Spanish12001417
LMArena Japanese1144—
LMArena Korean1137—

Instruction Following Nemotron 3 Super leads

Gemma 2 9B: 57.6 (#269), Nemotron 3 Super: 71.2 (#154)

Instruction Following benchmarks
BenchmarkGemma 2 9BNemotron 3 Super
LMArena Instruction Following11781347
LiveBench Instruction Following52.6%—

Long Context Nemotron 3 Super leads

Gemma 2 9B: 36.3 (#233), Nemotron 3 Super: 41.5 (#139)

Long Context benchmarks
BenchmarkGemma 2 9BNemotron 3 Super
LMArena Longer Query11971362

Writing & Preference Nemotron 3 Super leads

Gemma 2 9B: 32.1 (#281), Nemotron 3 Super: 55.9 (#140)

Writing & Preference benchmarks
BenchmarkGemma 2 9BNemotron 3 Super
LMArena Text12071378
LMArena Creative Writing12061317
LMArena Multi-Turn11931369
EQ-Bench Creative Writing841—
LiveBench Language25.5%—

Frequently asked questions

Is Gemma 2 9B better than Nemotron 3 Super?

Nemotron 3 Super is the stronger model overall, scoring 40.1 to 25.9 on the Noometry Index.

Is Gemma 2 9B or Nemotron 3 Super better for coding?

Nemotron 3 Super scores higher on coding benchmarks: 39.4 versus 29.4 in the Noometry coding category.

How many benchmarks do Gemma 2 9B and Nemotron 3 Super share?

15 benchmarks have published results for both models. Gemma 2 9B has 35 scored results on Noometry and Nemotron 3 Super has 21.

Related comparisons

Go deeper