Model comparison

Llama 3.2 90B vs Nemotron 3.5 Lightning

Nemotron 3.5 Lightning is the stronger model overall, scoring 39.3 to 27.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Llama 3.2 90B Meta

27.1

Rank #326 Confirmed

Nemotron 3.5 Lightning NVIDIA

39.3

Rank #156 Confirmed

Summary

  • The widest gap is in math, where Nemotron 3.5 Lightning leads 34.7 to 10.4.

Side by side

Llama 3.2 90B and Nemotron 3.5 Lightning specifications
Llama 3.2 90BNemotron 3.5 Lightning
ProviderMetaNVIDIA
Noometry Index27.139.3
Released2024-09-242026-08-11
WeightsOpenOpen
Context window—262K
Max output—262K
Input $ / M tokens—$0.06
Output $ / M tokens—$0.16
Results tracked918

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 3.2 90B: —, Nemotron 3.5 Lightning: 39.6 (#143)

Coding benchmarks
BenchmarkLlama 3.2 90BNemotron 3.5 Lightning
LMArena Coding—1370

Agentic & Tool Use Not comparable

Llama 3.2 90B: 29.7 (#73), Nemotron 3.5 Lightning: —

Agentic & Tool Use benchmarks
BenchmarkLlama 3.2 90BNemotron 3.5 Lightning
BALROG27.3%—

Reasoning Nemotron 3.5 Lightning leads

Llama 3.2 90B: 20.9 (#207), Nemotron 3.5 Lightning: 25.7 (#128)

Reasoning benchmarks
BenchmarkLlama 3.2 90BNemotron 3.5 Lightning
EnigmaEval0.4%—
LMArena Hard Prompts—1335
Epoch Capabilities Index125.5—

Math Nemotron 3.5 Lightning leads

Llama 3.2 90B: 10.4 (#302), Nemotron 3.5 Lightning: 34.7 (#156)

Math benchmarks
BenchmarkLlama 3.2 90BNemotron 3.5 Lightning
OTIS Mock AIME 2024-20252.6%—
LMArena Math—1355
MATH Level 539.4%—

Knowledge Nemotron 3.5 Lightning leads

Llama 3.2 90B: 21.7 (#269), Nemotron 3.5 Lightning: 36.9 (#154)

Knowledge benchmarks
BenchmarkLlama 3.2 90BNemotron 3.5 Lightning
GPQA Diamond41%—
LMArena Expert—1354
MMLU80.3%—

Multimodal Not comparable

Llama 3.2 90B: 24.9 (#119), Nemotron 3.5 Lightning: —

Multimodal benchmarks
BenchmarkLlama 3.2 90BNemotron 3.5 Lightning
LMArena Vision1000—
GeoBench52%—

Multilingual Not comparable

Llama 3.2 90B: —, Nemotron 3.5 Lightning: 44.0 (#175)

Multilingual benchmarks
BenchmarkLlama 3.2 90BNemotron 3.5 Lightning
LMArena Non-English—1292
LMArena Chinese—1356
LMArena French—1369
LMArena German—1280
LMArena Japanese—1213
LMArena Korean—1233
LMArena Russian—1257
LMArena Spanish—1321

Instruction Following Not comparable

Llama 3.2 90B: —, Nemotron 3.5 Lightning: 69.8 (#166)

Instruction Following benchmarks
BenchmarkLlama 3.2 90BNemotron 3.5 Lightning
LMArena Instruction Following—1317

Long Context Not comparable

Llama 3.2 90B: —, Nemotron 3.5 Lightning: 39.9 (#160)

Long Context benchmarks
BenchmarkLlama 3.2 90BNemotron 3.5 Lightning
LMArena Longer Query—1312

Writing & Preference Not comparable

Llama 3.2 90B: —, Nemotron 3.5 Lightning: 48.5 (#198)

Writing & Preference benchmarks
BenchmarkLlama 3.2 90BNemotron 3.5 Lightning
LMArena Text—1324
LMArena Creative Writing—1254
EQ-Bench Creative Writing—1280
LMArena Multi-Turn—1327

Frequently asked questions

Is Llama 3.2 90B better than Nemotron 3.5 Lightning?

Nemotron 3.5 Lightning is the stronger model overall, scoring 39.3 to 27.1 on the Noometry Index.

How many benchmarks do Llama 3.2 90B and Nemotron 3.5 Lightning share?

0 benchmarks have published results for both models. Llama 3.2 90B has 9 scored results on Noometry and Nemotron 3.5 Lightning has 18.

Related comparisons

Go deeper