Noometry

Model comparison

Amazon Nova Pro vs Olmo 3 32b Think

Olmo 3 32b Think is the stronger model overall, scoring 38.7 to 31.0 on the Noometry Index.

Last verified . 14 shared benchmarks.

Amazon Nova Pro Amazon

31.0

Rank #281 Confirmed

Olmo 3 32b Think Allen Institute for AI (Ai2)

38.7

Rank #183 Confirmed

Summary

  • They share 14 benchmarks with published results for both. Amazon Nova Pro scores higher in 0 categories and Olmo 3 32b Think in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Olmo 3 32b Think leads 36.5 to 28.5.
  • Olmo 3 32b Think has downloadable open weights; the other is API-only.

Side by side

Amazon Nova ProOlmo 3 32b Think
ProviderAmazonAllen Institute for AI (Ai2)
Noometry Index31.038.7
Released2024-12-03—
WeightsProprietaryOpen
Context window300K—
Max output10K—
Input $ / M tokens$0.80—
Output $ / M tokens$3.20—
Results tracked3814

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Olmo 3 32b Think leads

Amazon Nova Pro: 35.1 (#229), Olmo 3 32b Think: 38.6 (#172)

BenchmarkAmazon Nova ProOlmo 3 32b Think
LMArena Coding12701319
LiveBench Coding38.1%—

Agentic & Tool Use Not comparable

Amazon Nova Pro: 16.7 (#147), Olmo 3 32b Think: —

BenchmarkAmazon Nova ProOlmo 3 32b Think
Berkeley Function Calling Leaderboard25%—
TheAgentCompany1.7%—

Reasoning Olmo 3 32b Think leads

Amazon Nova Pro: 20.0 (#243), Olmo 3 32b Think: 25.9 (#140)

BenchmarkAmazon Nova ProOlmo 3 32b Think
LMArena Hard Prompts12461302
LiveBench Reasoning32.6%—
LiveBench Data Analysis48.3%—
Epoch Capabilities Index123.8—
LiveBench43.5%—

Math Olmo 3 32b Think leads

Amazon Nova Pro: 28.5 (#243), Olmo 3 32b Think: 36.5 (#165)

BenchmarkAmazon Nova ProOlmo 3 32b Think
LMArena Math12521316
Omni-MATH24.2%—
LiveBench Math38%—

Knowledge Olmo 3 32b Think leads

Amazon Nova Pro: 27.4 (#250), Olmo 3 32b Think: 35.0 (#190)

BenchmarkAmazon Nova ProOlmo 3 32b Think
LMArena Expert12111273
Humanity's Last Exam4.4%—
MMLU-Pro67.3%—
Confabulations30.1%—
Vectara Hallucination Rate5.1%—
GPQA (HELM)44.6%—
MMLU82%—

Multimodal Not comparable

Amazon Nova Pro: 25.0 (#126), Olmo 3 32b Think: —

BenchmarkAmazon Nova ProOlmo 3 32b Think
LMArena Vision980—

Multilingual Olmo 3 32b Think leads

Amazon Nova Pro: 39.7 (#223), Olmo 3 32b Think: 41.2 (#210)

BenchmarkAmazon Nova ProOlmo 3 32b Think
LMArena Non-English12341255
LMArena Chinese12441300
LMArena French12711291
LMArena German12431290
LMArena Russian12401254
LMArena Japanese1200—
LMArena Korean1203—
LMArena Spanish1182—

Instruction Following Olmo 3 32b Think leads

Amazon Nova Pro: 64.9 (#226), Olmo 3 32b Think: 67.2 (#198)

BenchmarkAmazon Nova ProOlmo 3 32b Think
LMArena Instruction Following12351275
LiveBench Instruction Following67.1%—
IFEval81.5%—

Long Context Olmo 3 32b Think leads

Amazon Nova Pro: 38.1 (#205), Olmo 3 32b Think: 39.4 (#182)

BenchmarkAmazon Nova ProOlmo 3 32b Think
LMArena Longer Query12551296

Writing & Preference Olmo 3 32b Think leads

Amazon Nova Pro: 43.9 (#226), Olmo 3 32b Think: 49.1 (#193)

BenchmarkAmazon Nova ProOlmo 3 32b Think
LMArena Text12591300
LMArena Creative Writing12121256
LMArena Multi-Turn12461290
Short-Story Creative Writing60.5%—
WildBench77.7%—
LiveBench Language37%—

Frequently asked questions

Is Amazon Nova Pro better than Olmo 3 32b Think?

Olmo 3 32b Think is the stronger model overall, scoring 38.7 to 31.0 on the Noometry Index.

Is Amazon Nova Pro or Olmo 3 32b Think better for coding?

Olmo 3 32b Think scores higher on coding benchmarks: 38.6 versus 35.1 in the Noometry coding category.

How many benchmarks do Amazon Nova Pro and Olmo 3 32b Think share?

14 benchmarks have published results for both models. Amazon Nova Pro has 38 scored results on Noometry and Olmo 3 32b Think has 14.

Related comparisons

Go deeper