Noometry

Model comparison

Nemotron 3.5 Lightning vs Qwen3 8B

Nemotron 3.5 Lightning is the stronger model overall, scoring 39.3 to 33.3 on the Noometry Index.

Last verified . 0 shared benchmarks.

Nemotron 3.5 Lightning NVIDIA

39.3

Rank #156 Confirmed

Qwen3 8B Alibaba (Qwen)

33.3

Rank #237 Confirmed

Summary

  • The widest gap is in reasoning, where Nemotron 3.5 Lightning leads 25.7 to 16.1.
  • Nemotron 3.5 Lightning is cheaper at $0.06 / $0.16 per million input/output tokens, against $0.18 / $0.70 for Qwen3 8B.
  • Nemotron 3.5 Lightning accepts more context: 262K tokens versus 131K.

Side by side

Nemotron 3.5 LightningQwen3 8B
ProviderNVIDIAAlibaba (Qwen)
Noometry Index39.333.3
Released2026-08-112025-04
WeightsOpenOpen
Context window262K131K
Max output262K8K
Input $ / M tokens$0.06$0.18
Output $ / M tokens$0.16$0.70
Results tracked1811

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nemotron 3.5 Lightning leads

Nemotron 3.5 Lightning: 39.6 (#143), Qwen3 8B: 33.4 (#245)

BenchmarkNemotron 3.5 LightningQwen3 8B
SciCode—22.6%
LMArena Coding1370—

Agentic & Tool Use Not comparable

Nemotron 3.5 Lightning: —, Qwen3 8B: 29.9 (#71)

BenchmarkNemotron 3.5 LightningQwen3 8B
Berkeley Function Calling Leaderboard—42.6%

Reasoning Nemotron 3.5 Lightning leads

Nemotron 3.5 Lightning: 25.7 (#128), Qwen3 8B: 16.1 (#299)

BenchmarkNemotron 3.5 LightningQwen3 8B
CritPt—0%
Chess Puzzles—5%
LMArena Hard Prompts1335—
DTBench—59.7%
LMCA—8.8%
Epoch Capabilities Index—136.17

Math Nemotron 3.5 Lightning leads

Nemotron 3.5 Lightning: 34.7 (#156), Qwen3 8B: 33.3 (#176)

BenchmarkNemotron 3.5 LightningQwen3 8B
OTIS Mock AIME 2024-2025—56.1%
LMArena Math1355—

Knowledge Too close to call

Nemotron 3.5 Lightning: 36.9 (#154), Qwen3 8B: 36.1 (#164)

BenchmarkNemotron 3.5 LightningQwen3 8B
GPQA Diamond—56.8%
Vectara Hallucination Rate—4.8%
LMArena Expert1354—

Multilingual Not comparable

Nemotron 3.5 Lightning: 44.0 (#175), Qwen3 8B: —

BenchmarkNemotron 3.5 LightningQwen3 8B
LMArena Non-English1292—
LMArena Chinese1356—
LMArena French1369—
LMArena German1280—
LMArena Japanese1213—
LMArena Korean1233—
LMArena Russian1257—
LMArena Spanish1321—

Instruction Following Not comparable

Nemotron 3.5 Lightning: 69.8 (#166), Qwen3 8B: —

BenchmarkNemotron 3.5 LightningQwen3 8B
LMArena Instruction Following1317—

Long Context Nemotron 3.5 Lightning leads

Nemotron 3.5 Lightning: 39.9 (#160), Qwen3 8B: 37.8 (#205)

BenchmarkNemotron 3.5 LightningQwen3 8B
Fiction.LiveBench—62.1%
LMArena Longer Query1312—

Writing & Preference Not comparable

Nemotron 3.5 Lightning: 48.5 (#198), Qwen3 8B: —

BenchmarkNemotron 3.5 LightningQwen3 8B
LMArena Text1324—
LMArena Creative Writing1254—
EQ-Bench Creative Writing1280—
LMArena Multi-Turn1327—

Frequently asked questions

Is Nemotron 3.5 Lightning better than Qwen3 8B?

Nemotron 3.5 Lightning is the stronger model overall, scoring 39.3 to 33.3 on the Noometry Index.

Which is cheaper, Nemotron 3.5 Lightning or Qwen3 8B?

Nemotron 3.5 Lightning is cheaper. It lists at $0.06 per million input tokens and $0.16 per million output tokens; Qwen3 8B lists at $0.18 and $0.70.

Is Nemotron 3.5 Lightning or Qwen3 8B better for coding?

Nemotron 3.5 Lightning scores higher on coding benchmarks: 39.6 versus 33.4 in the Noometry coding category.

Which has the bigger context window?

Nemotron 3.5 Lightning does, with 262K tokens against 131K.

How many benchmarks do Nemotron 3.5 Lightning and Qwen3 8B share?

0 benchmarks have published results for both models. Nemotron 3.5 Lightning has 18 scored results on Noometry and Qwen3 8B has 11.

Related comparisons

Go deeper