Noometry

Model comparison

Nemotron 3 Ultra vs Qwen3.8 27B

Qwen3.8 27B is the stronger model overall, scoring 46.0 to 42.5 on the Noometry Index.

Last verified . 24 shared benchmarks.

Nemotron 3 Ultra NVIDIA

42.5

Rank #113 Confirmed

Qwen3.8 27B Alibaba (Qwen)

46.0

Rank #68 Confirmed

Summary

  • They share 24 benchmarks with published results for both. Nemotron 3 Ultra scores higher in 2 categories and Qwen3.8 27B in 7 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in coding, where Qwen3.8 27B leads 50.5 to 38.1.
  • The biggest single-benchmark swing is APEX-Agents: 22.7% for Nemotron 3 Ultra and 47.5% for Qwen3.8 27B.
  • Nemotron 3 Ultra is cheaper at $0.50 / $2.20 per million input/output tokens, against $0.99 / $1.49 for Qwen3.8 27B.

Side by side

Nemotron 3 UltraQwen3.8 27B
ProviderNVIDIAAlibaba (Qwen)
Noometry Index42.546.0
Released2026-06-042026-08-14
WeightsOpenOpen
Context window262K262K
Max output128K33K
Input $ / M tokens$0.50$0.99
Output $ / M tokens$2.20$1.49
Results tracked3031

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Qwen3.8 27B leads

Nemotron 3 Ultra: 38.1 (#182), Qwen3.8 27B: 50.5 (#44)

BenchmarkNemotron 3 UltraQwen3.8 27B
SciCode40.3%46.6%
LMArena Coding14681482
FrontierCode13.6%—
LMArena WebDev—1593
WeirdML43.5%—

Agentic & Tool Use Qwen3.8 27B leads

Nemotron 3 Ultra: 23.4 (#126), Qwen3.8 27B: 32.9 (#57)

BenchmarkNemotron 3 UltraQwen3.8 27B
APEX-Agents22.7%47.5%

Reasoning Qwen3.8 27B leads

Nemotron 3 Ultra: 31.0 (#82), Qwen3.8 27B: 41.0 (#54)

BenchmarkNemotron 3 UltraQwen3.8 27B
CritPt3.1%5.4%
LMArena Hard Prompts14521460
DTBench90.1%88%
LMCA36.9%41.4%
Epoch Capabilities Index146.17149.38
ARC-AGI-2—42.4%
NYT Connections (extended)—54.5%
ARC-AGI-1—87.5%
Chess Puzzles12%—
Mystery Game Puzzles20%—
Surface Evolver Bench—45%

Math Qwen3.8 27B leads

Nemotron 3 Ultra: 35.3 (#187), Qwen3.8 27B: 37.1 (#161)

BenchmarkNemotron 3 UltraQwen3.8 27B
ProofBench2%16%
LMArena Math14571456
OTIS Mock AIME 2024-202586.7%—

Knowledge Nemotron 3 Ultra leads

Nemotron 3 Ultra: 52.5 (#61), Qwen3.8 27B: 41.6 (#109)

BenchmarkNemotron 3 UltraQwen3.8 27B
LMArena Expert14721482
GPQA Diamond85.4%—

Multimodal Not comparable

Nemotron 3 Ultra: —, Qwen3.8 27B: 41.3 (#37)

BenchmarkNemotron 3 UltraQwen3.8 27B
LMArena Vision—1271

Multilingual Too close to call

Nemotron 3 Ultra: 53.5 (#64), Qwen3.8 27B: 53.7 (#60)

BenchmarkNemotron 3 UltraQwen3.8 27B
LMArena Non-English14271430
LMArena Chinese14971504
LMArena French14721465
LMArena German14711438
LMArena Korean13861393
LMArena Russian14171415
LMArena Spanish14541448
LMArena Japanese—1384

Instruction Following Qwen3.8 27B leads

Nemotron 3 Ultra: 74.7 (#88), Qwen3.8 27B: 75.8 (#53)

BenchmarkNemotron 3 UltraQwen3.8 27B
LMArena Instruction Following14181439

Long Context Too close to call

Nemotron 3 Ultra: 43.9 (#81), Qwen3.8 27B: 44.3 (#70)

BenchmarkNemotron 3 UltraQwen3.8 27B
LMArena Longer Query14371450

Writing & Preference Too close to call

Nemotron 3 Ultra: 66.3 (#36), Qwen3.8 27B: 65.8 (#43)

BenchmarkNemotron 3 UltraQwen3.8 27B
LMArena Text14451441
LMArena Creative Writing13981384
EQ-Bench Creative Writing16921671
LMArena Multi-Turn14111441

Frequently asked questions

Is Nemotron 3 Ultra better than Qwen3.8 27B?

Qwen3.8 27B is the stronger model overall, scoring 46.0 to 42.5 on the Noometry Index.

Which is cheaper, Nemotron 3 Ultra or Qwen3.8 27B?

Nemotron 3 Ultra is cheaper. It lists at $0.50 per million input tokens and $2.20 per million output tokens; Qwen3.8 27B lists at $0.99 and $1.49.

Is Nemotron 3 Ultra or Qwen3.8 27B better for coding?

Qwen3.8 27B scores higher on coding benchmarks: 50.5 versus 38.1 in the Noometry coding category.

Which has the bigger context window?

Both accept 262K tokens.

How many benchmarks do Nemotron 3 Ultra and Qwen3.8 27B share?

24 benchmarks have published results for both models. Nemotron 3 Ultra has 30 scored results on Noometry and Qwen3.8 27B has 31.

Related comparisons

Go deeper