Model comparison

MiniMax-M2.5 vs Nemotron 3.5 Lightning

Nemotron 3.5 Lightning is the stronger model overall, scoring 40.0 to 38.3 on the Noometry Index.

Last verified . 18 shared benchmarks.

MiniMax-M2.5 MiniMax

38.3

Rank #188 Confirmed

Nemotron 3.5 Lightning NVIDIA

40.0

Rank #155 Confirmed

Summary

  • They share 18 benchmarks with published results for both. MiniMax-M2.5 scores higher in 5 categories and Nemotron 3.5 Lightning in 3 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Nemotron 3.5 Lightning leads 37.5 to 26.9.
  • Nemotron 3.5 Lightning is cheaper at $0.05 / $0.20 per million input/output tokens, against $0.30 / $1.20 for MiniMax-M2.5.
  • Nemotron 3.5 Lightning accepts more context: 262K tokens versus 205K.

Side by side

MiniMax-M2.5 and Nemotron 3.5 Lightning specifications
MiniMax-M2.5Nemotron 3.5 Lightning
ProviderMiniMaxNVIDIA
Noometry Index38.340.0
Released2026-02-122026-08-11
WeightsOpenOpen
Context window205K262K
Max output131K262K
Input $ / M tokens$0.30$0.05
Output $ / M tokens$1.20$0.20
Results tracked3318

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding MiniMax-M2.5 leads

MiniMax-M2.5: 48.1 (#58), Nemotron 3.5 Lightning: 40.4 (#141)

Coding benchmarks
BenchmarkMiniMax-M2.5Nemotron 3.5 Lightning
LMArena Coding13811375
SWE-bench Verified (bash only)75.8%—
LMArena WebDev1387—
SWE-bench Multilingual68.3%—
ALE-Bench618.17—

Agentic & Tool Use Not comparable

MiniMax-M2.5: 30.4 (#77), Nemotron 3.5 Lightning: —

Agentic & Tool Use benchmarks
BenchmarkMiniMax-M2.5Nemotron 3.5 Lightning
Terminal-Bench42.7%—
Vending-Bench 2-23.16—

Reasoning Nemotron 3.5 Lightning leads

MiniMax-M2.5: 17.5 (#292), Nemotron 3.5 Lightning: 26.8 (#127)

Reasoning benchmarks
BenchmarkMiniMax-M2.5Nemotron 3.5 Lightning
LMArena Hard Prompts13721337
ARC-AGI-24.9%—
Kagi LLM Benchmark55.2%—
NYT Connections (extended)16.8%—
ARC-AGI-163.7%—
Epoch Capabilities Index146.68—

Math Nemotron 3.5 Lightning leads

MiniMax-M2.5: 26.9 (#253), Nemotron 3.5 Lightning: 37.5 (#155)

Math benchmarks
BenchmarkMiniMax-M2.5Nemotron 3.5 Lightning
LMArena Math13781359
ProofBench4%—

Knowledge MiniMax-M2.5 leads

MiniMax-M2.5: 39.2 (#135), Nemotron 3.5 Lightning: 37.5 (#154)

Knowledge benchmarks
BenchmarkMiniMax-M2.5Nemotron 3.5 Lightning
LMArena Expert13791356
Vectara Hallucination Rate9.1%—

Multilingual MiniMax-M2.5 leads

MiniMax-M2.5: 47.1 (#152), Nemotron 3.5 Lightning: 44.0 (#180)

Multilingual benchmarks
BenchmarkMiniMax-M2.5Nemotron 3.5 Lightning
LMArena Non-English13381295
LMArena Chinese13931359
LMArena French13621366
LMArena German13621282
LMArena Japanese11711206
LMArena Korean12321238
LMArena Russian13581253
LMArena Spanish13541345

Instruction Following MiniMax-M2.5 leads

MiniMax-M2.5: 71.5 (#148), Nemotron 3.5 Lightning: 69.6 (#170)

Instruction Following benchmarks
BenchmarkMiniMax-M2.5Nemotron 3.5 Lightning
LMArena Instruction Following13531318

Long Context Nemotron 3.5 Lightning leads

MiniMax-M2.5: 37.5 (#216), Nemotron 3.5 Lightning: 39.9 (#165)

Long Context benchmarks
BenchmarkMiniMax-M2.5Nemotron 3.5 Lightning
LMArena Longer Query13661314
CL-bench11.4%—
CL-bench Life6.3%—

Writing & Preference MiniMax-M2.5 leads

MiniMax-M2.5: 53.9 (#153), Nemotron 3.5 Lightning: 48.5 (#201)

Writing & Preference benchmarks
BenchmarkMiniMax-M2.5Nemotron 3.5 Lightning
LMArena Text13591327
LMArena Creative Writing13311254
EQ-Bench Creative Writing13611280
LMArena Multi-Turn13641328

Frequently asked questions

Is MiniMax-M2.5 better than Nemotron 3.5 Lightning?

Nemotron 3.5 Lightning is the stronger model overall, scoring 40.0 to 38.3 on the Noometry Index.

Which is cheaper, MiniMax-M2.5 or Nemotron 3.5 Lightning?

Nemotron 3.5 Lightning is cheaper. It lists at $0.05 per million input tokens and $0.20 per million output tokens; MiniMax-M2.5 lists at $0.30 and $1.20.

Is MiniMax-M2.5 or Nemotron 3.5 Lightning better for coding?

MiniMax-M2.5 scores higher on coding benchmarks: 48.1 versus 40.4 in the Noometry coding category.

Which has the bigger context window?

Nemotron 3.5 Lightning does, with 262K tokens against 205K.

How many benchmarks do MiniMax-M2.5 and Nemotron 3.5 Lightning share?

18 benchmarks have published results for both models. MiniMax-M2.5 has 33 scored results on Noometry and Nemotron 3.5 Lightning has 18.

Related comparisons

Go deeper