Model comparison

Magistral Small vs Nemotron 3.5 Lightning

Nemotron 3.5 Lightning is the stronger model overall, scoring 40.0 to 30.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Magistral Small Mistral AI

30.2

Rank #296 Confirmed

Nemotron 3.5 Lightning NVIDIA

40.0

Rank #155 Confirmed

Summary

  • The widest gap is in reasoning, where Nemotron 3.5 Lightning leads 26.8 to 6.8.
  • Nemotron 3.5 Lightning is cheaper at $0.05 / $0.20 per million input/output tokens, against $0.50 / $1.50 for Magistral Small.
  • Nemotron 3.5 Lightning accepts more context: 262K tokens versus 128K.

Side by side

Magistral Small and Nemotron 3.5 Lightning specifications
Magistral SmallNemotron 3.5 Lightning
ProviderMistral AINVIDIA
Noometry Index30.240.0
Released2025-06-102026-08-11
WeightsOpenOpen
Context window128K262K
Max output40K262K
Input $ / M tokens$0.50$0.05
Output $ / M tokens$1.50$0.20
Results tracked1018

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nemotron 3.5 Lightning leads

Magistral Small: 38.4 (#176), Nemotron 3.5 Lightning: 40.4 (#141)

Coding benchmarks
BenchmarkMagistral SmallNemotron 3.5 Lightning
SciCode35.2%—
LMArena Coding—1375

Reasoning Nemotron 3.5 Lightning leads

Magistral Small: 6.8 (#350), Nemotron 3.5 Lightning: 26.8 (#127)

Reasoning benchmarks
BenchmarkMagistral SmallNemotron 3.5 Lightning
ARC-AGI-20%—
Kagi LLM Benchmark6.3%—
ARC-AGI-15%—
CritPt0.3%—
Chess Puzzles3%—
LMArena Hard Prompts—1337
DTBench61.3%—
Epoch Capabilities Index133.19—

Math Nemotron 3.5 Lightning leads

Magistral Small: 26.2 (#261), Nemotron 3.5 Lightning: 37.5 (#155)

Math benchmarks
BenchmarkMagistral SmallNemotron 3.5 Lightning
OTIS Mock AIME 2024-202530%—
LMArena Math—1359

Knowledge Nemotron 3.5 Lightning leads

Magistral Small: 30.9 (#223), Nemotron 3.5 Lightning: 37.5 (#154)

Knowledge benchmarks
BenchmarkMagistral SmallNemotron 3.5 Lightning
GPQA Diamond56.1%—
LMArena Expert—1356

Multilingual Not comparable

Magistral Small: —, Nemotron 3.5 Lightning: 44.0 (#180)

Multilingual benchmarks
BenchmarkMagistral SmallNemotron 3.5 Lightning
LMArena Non-English—1295
LMArena Chinese—1359
LMArena French—1366
LMArena German—1282
LMArena Japanese—1206
LMArena Korean—1238
LMArena Russian—1253
LMArena Spanish—1345

Instruction Following Not comparable

Magistral Small: —, Nemotron 3.5 Lightning: 69.6 (#170)

Instruction Following benchmarks
BenchmarkMagistral SmallNemotron 3.5 Lightning
LMArena Instruction Following—1318

Long Context Not comparable

Magistral Small: —, Nemotron 3.5 Lightning: 39.9 (#165)

Long Context benchmarks
BenchmarkMagistral SmallNemotron 3.5 Lightning
LMArena Longer Query—1314

Writing & Preference Not comparable

Magistral Small: —, Nemotron 3.5 Lightning: 48.5 (#201)

Writing & Preference benchmarks
BenchmarkMagistral SmallNemotron 3.5 Lightning
LMArena Text—1327
LMArena Creative Writing—1254
EQ-Bench Creative Writing—1280
LMArena Multi-Turn—1328

Frequently asked questions

Is Magistral Small better than Nemotron 3.5 Lightning?

Nemotron 3.5 Lightning is the stronger model overall, scoring 40.0 to 30.2 on the Noometry Index.

Which is cheaper, Magistral Small or Nemotron 3.5 Lightning?

Nemotron 3.5 Lightning is cheaper. It lists at $0.05 per million input tokens and $0.20 per million output tokens; Magistral Small lists at $0.50 and $1.50.

Is Magistral Small or Nemotron 3.5 Lightning better for coding?

Nemotron 3.5 Lightning scores higher on coding benchmarks: 40.4 versus 38.4 in the Noometry coding category.

Which has the bigger context window?

Nemotron 3.5 Lightning does, with 262K tokens against 128K.

How many benchmarks do Magistral Small and Nemotron 3.5 Lightning share?

0 benchmarks have published results for both models. Magistral Small has 10 scored results on Noometry and Nemotron 3.5 Lightning has 18.

Related comparisons

Go deeper