Noometry

Model comparison

Nemotron 3 Ultra vs o1-mini

Nemotron 3 Ultra is the stronger model overall, scoring 44.7 to 33.7 on the Noometry Index.

Last verified . 20 shared benchmarks.

Nemotron 3 Ultra NVIDIA

44.7

Rank #71 Confirmed

o1-mini OpenAI

33.7

Rank #230 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Nemotron 3 Ultra scores higher in 8 categories and o1-mini in 0 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Nemotron 3 Ultra leads 30.3 to 8.9.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 86.7% for Nemotron 3 Ultra and 46.9% for o1-mini.
  • Nemotron 3 Ultra has downloadable open weights; the other is API-only.

Side by side

Nemotron 3 Ultrao1-mini
ProviderNVIDIAOpenAI
Noometry Index44.733.7
Released2026-06-042024-09-12
WeightsOpenProprietary
Context window262K—
Max output128K—
Input $ / M tokens$0.60—
Output $ / M tokens$2.40—
Results tracked2939

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nemotron 3 Ultra leads

Nemotron 3 Ultra: 37.7 (#174), o1-mini: 35.1 (#218)

BenchmarkNemotron 3 Ultrao1-mini
WeirdML43.5%36.3%
LMArena Coding14681362
FrontierCode13.6%—
Aider Polyglot—32.9%
SciCode40.3%—
LiveBench Coding—48%
HumanEval+—89%
MBPP+—78.8%

Agentic & Tool Use Not comparable

Nemotron 3 Ultra: —, o1-mini: 24.3 (#112)

BenchmarkNemotron 3 Ultrao1-mini
Cybench—10%

Reasoning Nemotron 3 Ultra leads

Nemotron 3 Ultra: 30.3 (#78), o1-mini: 8.9 (#340)

BenchmarkNemotron 3 Ultrao1-mini
LMArena Hard Prompts14521333
Epoch Capabilities Index146.2135.82
ARC-AGI-2—0.8%
SimpleBench—18.1%
ARC-AGI-1—14%
CritPt3.1%—
Chess Puzzles12%—
LiveBench Reasoning—72.3%
Mystery Game Puzzles20%—
DTBench90.1%—
LiveBench Data Analysis—57.9%
LMCA36.9%—
LiveBench—57.8%

Math Too close to call

Nemotron 3 Ultra: 34.4 (#160), o1-mini: 33.7 (#168)

BenchmarkNemotron 3 Ultrao1-mini
OTIS Mock AIME 2024-202586.7%46.9%
LMArena Math14561358
ProofBench2%—
LiveBench Math—62%
MATH Level 5—89.2%
FrontierMath (Feb 2025 set)—1.7%

Knowledge Nemotron 3 Ultra leads

Nemotron 3 Ultra: 52.5 (#56), o1-mini: 34.8 (#180)

BenchmarkNemotron 3 Ultrao1-mini
GPQA Diamond85.4%62.4%
LMArena Expert14721316
Confabulations—18.6%

Multilingual Nemotron 3 Ultra leads

Nemotron 3 Ultra: 53.7 (#61), o1-mini: 43.8 (#177)

BenchmarkNemotron 3 Ultrao1-mini
LMArena Non-English14271289
LMArena Chinese14981314
LMArena French14751292
LMArena German14711278
LMArena Korean13871223
LMArena Russian14151283
LMArena Spanish14521302
LMArena Japanese—1245

Instruction Following Nemotron 3 Ultra leads

Nemotron 3 Ultra: 74.9 (#84), o1-mini: 67.0 (#200)

BenchmarkNemotron 3 Ultrao1-mini
LMArena Instruction Following14171304
LiveBench Instruction Following—65.4%

Long Context Nemotron 3 Ultra leads

Nemotron 3 Ultra: 43.9 (#77), o1-mini: 40.1 (#156)

BenchmarkNemotron 3 Ultrao1-mini
LMArena Longer Query14371321

Writing & Preference Nemotron 3 Ultra leads

Nemotron 3 Ultra: 66.3 (#35), o1-mini: 48.6 (#196)

BenchmarkNemotron 3 Ultrao1-mini
LMArena Text14441317
LMArena Creative Writing13921244
LMArena Multi-Turn14121314
Short-Story Creative Writing—64.9%
EQ-Bench Creative Writing1692—
LiveBench Language—40.9%

Frequently asked questions

Is Nemotron 3 Ultra better than o1-mini?

Nemotron 3 Ultra is the stronger model overall, scoring 44.7 to 33.7 on the Noometry Index.

Is Nemotron 3 Ultra or o1-mini better for coding?

Nemotron 3 Ultra scores higher on coding benchmarks: 37.7 versus 35.1 in the Noometry coding category.

How many benchmarks do Nemotron 3 Ultra and o1-mini share?

20 benchmarks have published results for both models. Nemotron 3 Ultra has 29 scored results on Noometry and o1-mini has 39.

Related comparisons

Go deeper