Model comparison

Nemotron 3.5 Lightning vs OLMo 2 Furious 13B

Nemotron 3.5 Lightning is the stronger model overall, scoring 40.0 to 29.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

Summary

  • The widest gap is in knowledge, where Nemotron 3.5 Lightning leads 37.5 to 18.3.

Side by side

Nemotron 3.5 Lightning and OLMo 2 Furious 13B specifications
Nemotron 3.5 LightningOLMo 2 Furious 13B
ProviderNVIDIAAllen Institute for AI (Ai2)
Noometry Index40.029.7
Released2026-08-112024-12-31
WeightsOpenOpen
Context window262K—
Max output262K—
Input $ / M tokens$0.05—
Output $ / M tokens$0.20—
Results tracked1812

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nemotron 3.5 Lightning leads

Nemotron 3.5 Lightning: 40.4 (#141), OLMo 2 Furious 13B: 28.6 (#313)

Coding benchmarks
BenchmarkNemotron 3.5 LightningOLMo 2 Furious 13B
LiveBench Coding—10.4%
LMArena Coding1375—

Reasoning Nemotron 3.5 Lightning leads

Nemotron 3.5 Lightning: 26.8 (#127), OLMo 2 Furious 13B: 15.5 (#314)

Reasoning benchmarks
BenchmarkNemotron 3.5 LightningOLMo 2 Furious 13B
LiveBench Reasoning—16.3%
LMArena Hard Prompts1337—
LiveBench Data Analysis—20.6%
LiveBench—22.1%

Math Nemotron 3.5 Lightning leads

Nemotron 3.5 Lightning: 37.5 (#155), OLMo 2 Furious 13B: 23.1 (#273)

Math benchmarks
BenchmarkNemotron 3.5 LightningOLMo 2 Furious 13B
Omni-MATH—15.6%
LiveBench Math—13.6%
LMArena Math1359—

Knowledge Nemotron 3.5 Lightning leads

Nemotron 3.5 Lightning: 37.5 (#154), OLMo 2 Furious 13B: 18.3 (#283)

Knowledge benchmarks
BenchmarkNemotron 3.5 LightningOLMo 2 Furious 13B
MMLU-Pro—31%
GPQA (HELM)—31.6%
LMArena Expert1356—

Multilingual Not comparable

Nemotron 3.5 Lightning: 44.0 (#180), OLMo 2 Furious 13B: —

Multilingual benchmarks
BenchmarkNemotron 3.5 LightningOLMo 2 Furious 13B
LMArena Non-English1295—
LMArena Chinese1359—
LMArena French1366—
LMArena German1282—
LMArena Japanese1206—
LMArena Korean1238—
LMArena Russian1253—
LMArena Spanish1345—

Instruction Following Nemotron 3.5 Lightning leads

Nemotron 3.5 Lightning: 69.6 (#170), OLMo 2 Furious 13B: 60.9 (#248)

Instruction Following benchmarks
BenchmarkNemotron 3.5 LightningOLMo 2 Furious 13B
LiveBench Instruction Following—60.6%
IFEval—73%
LMArena Instruction Following1318—

Long Context Not comparable

Nemotron 3.5 Lightning: 39.9 (#165), OLMo 2 Furious 13B: —

Long Context benchmarks
BenchmarkNemotron 3.5 LightningOLMo 2 Furious 13B
LMArena Longer Query1314—

Writing & Preference Nemotron 3.5 Lightning leads

Nemotron 3.5 Lightning: 48.5 (#201), OLMo 2 Furious 13B: 42.9 (#230)

Writing & Preference benchmarks
BenchmarkNemotron 3.5 LightningOLMo 2 Furious 13B
LMArena Text1327—
LMArena Creative Writing1254—
EQ-Bench Creative Writing1280—
WildBench—68.9%
LMArena Multi-Turn1328—
LiveBench Language—11.2%

Frequently asked questions

Is Nemotron 3.5 Lightning better than OLMo 2 Furious 13B?

Nemotron 3.5 Lightning is the stronger model overall, scoring 40.0 to 29.7 on the Noometry Index.

Is Nemotron 3.5 Lightning or OLMo 2 Furious 13B better for coding?

Nemotron 3.5 Lightning scores higher on coding benchmarks: 40.4 versus 28.6 in the Noometry coding category.

How many benchmarks do Nemotron 3.5 Lightning and OLMo 2 Furious 13B share?

0 benchmarks have published results for both models. Nemotron 3.5 Lightning has 18 scored results on Noometry and OLMo 2 Furious 13B has 12.

Related comparisons

Go deeper