Model comparison

Inkling-Small vs Nemotron 3.5 Lightning

Inkling-Small is the stronger model overall, scoring 46.5 to 40.0 on the Noometry Index. Nemotron 3.5 Lightning costs 7.3× less per token, which makes it the better buy when Inkling-Small's lead doesn't matter for your workload.

Last verified . 18 shared benchmarks.

Inkling-Small Thinking Machines Lab

46.5

Rank #63 Confirmed

Nemotron 3.5 Lightning NVIDIA

40.0

Rank #155 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Inkling-Small scores higher in 8 categories and Nemotron 3.5 Lightning in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Inkling-Small leads 38.6 to 26.8.
  • Nemotron 3.5 Lightning is cheaper at $0.05 / $0.20 per million input/output tokens, against $0.45 / $1.20 for Inkling-Small.
  • Inkling-Small accepts more context: 524K tokens versus 262K.

Side by side

Inkling-Small and Nemotron 3.5 Lightning specifications
Inkling-SmallNemotron 3.5 Lightning
ProviderThinking Machines LabNVIDIA
Noometry Index46.540.0
Released2026-07-152026-08-11
WeightsOpenOpen
Context window524K262K
Max output1.05M262K
Input $ / M tokens$0.45$0.05
Output $ / M tokens$1.20$0.20
Results tracked3318

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Inkling-Small leads

Inkling-Small: 43.6 (#85), Nemotron 3.5 Lightning: 40.4 (#141)

Coding benchmarks
BenchmarkInkling-SmallNemotron 3.5 Lightning
LMArena Coding14511375
LMArena WebDev1409—
SciCode48.7%—

Reasoning Inkling-Small leads

Inkling-Small: 38.6 (#63), Nemotron 3.5 Lightning: 26.8 (#127)

Reasoning benchmarks
BenchmarkInkling-SmallNemotron 3.5 Lightning
LMArena Hard Prompts14231337
ARC-AGI-240.1%—
ARC-AGI-184%—
CritPt8.3%—
Chess Puzzles18%—
Mystery Game Puzzles6%—
Epoch Capabilities Index150.15—

Math Inkling-Small leads

Inkling-Small: 45.1 (#77), Nemotron 3.5 Lightning: 37.5 (#155)

Math benchmarks
BenchmarkInkling-SmallNemotron 3.5 Lightning
LMArena Math14591359
FrontierMath (Tiers 1-3)46.3%—
FrontierMath Tier 417.1%—
OTIS Mock AIME 2024-202590%—
ProofBench6%—

Knowledge Inkling-Small leads

Inkling-Small: 48.2 (#77), Nemotron 3.5 Lightning: 37.5 (#154)

Knowledge benchmarks
BenchmarkInkling-SmallNemotron 3.5 Lightning
LMArena Expert14421356
GPQA Diamond88.5%—
SimpleQA Verified19.1%—

Multimodal Not comparable

Inkling-Small: 39.1 (#62), Nemotron 3.5 Lightning: —

Multimodal benchmarks
BenchmarkInkling-SmallNemotron 3.5 Lightning
LMArena Vision1235—

Multilingual Inkling-Small leads

Inkling-Small: 51.7 (#104), Nemotron 3.5 Lightning: 44.0 (#180)

Multilingual benchmarks
BenchmarkInkling-SmallNemotron 3.5 Lightning
LMArena Non-English14021295
LMArena Chinese14651359
LMArena French14361366
LMArena German14051282
LMArena Japanese14051206
LMArena Korean13631238
LMArena Russian13911253
LMArena Spanish14281345

Instruction Following Inkling-Small leads

Inkling-Small: 73.8 (#114), Nemotron 3.5 Lightning: 69.6 (#170)

Instruction Following benchmarks
BenchmarkInkling-SmallNemotron 3.5 Lightning
LMArena Instruction Following13991318

Long Context Inkling-Small leads

Inkling-Small: 42.7 (#118), Nemotron 3.5 Lightning: 39.9 (#165)

Long Context benchmarks
BenchmarkInkling-SmallNemotron 3.5 Lightning
LMArena Longer Query14011314

Writing & Preference Inkling-Small leads

Inkling-Small: 59.6 (#107), Nemotron 3.5 Lightning: 48.5 (#201)

Writing & Preference benchmarks
BenchmarkInkling-SmallNemotron 3.5 Lightning
LMArena Text14141327
LMArena Creative Writing13311254
EQ-Bench Creative Writing14911280
LMArena Multi-Turn14181328

Frequently asked questions

Is Inkling-Small better than Nemotron 3.5 Lightning?

Inkling-Small is the stronger model overall, scoring 46.5 to 40.0 on the Noometry Index. Nemotron 3.5 Lightning costs 7.3× less per token, which makes it the better buy when Inkling-Small's lead doesn't matter for your workload.

Which is cheaper, Inkling-Small or Nemotron 3.5 Lightning?

Nemotron 3.5 Lightning is cheaper. It lists at $0.05 per million input tokens and $0.20 per million output tokens; Inkling-Small lists at $0.45 and $1.20.

Is Inkling-Small or Nemotron 3.5 Lightning better for coding?

Inkling-Small scores higher on coding benchmarks: 43.6 versus 40.4 in the Noometry coding category.

Which has the bigger context window?

Inkling-Small does, with 524K tokens against 262K.

How many benchmarks do Inkling-Small and Nemotron 3.5 Lightning share?

18 benchmarks have published results for both models. Inkling-Small has 33 scored results on Noometry and Nemotron 3.5 Lightning has 18.

Related comparisons

Go deeper