Noometry

Model comparison

Amazon Nova Pro vs Olmo 3.1 32b Think

Olmo 3.1 32b Think is the stronger model overall, scoring 37.9 to 31.0 on the Noometry Index.

Last verified . 15 shared benchmarks.

Amazon Nova Pro Amazon

31.0

Rank #281 Confirmed

Olmo 3.1 32b Think Allen Institute for AI (Ai2)

37.9

Rank #191 Confirmed

Summary

  • They share 15 benchmarks with published results for both. Amazon Nova Pro scores higher in 1 category and Olmo 3.1 32b Think in 7 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Olmo 3.1 32b Think leads 35.7 to 27.4.
  • Olmo 3.1 32b Think has downloadable open weights; the other is API-only.

Side by side

Amazon Nova ProOlmo 3.1 32b Think
ProviderAmazonAllen Institute for AI (Ai2)
Noometry Index31.037.9
Released2024-12-03—
WeightsProprietaryOpen
Context window300K—
Max output10K—
Input $ / M tokens$0.80—
Output $ / M tokens$3.20—
Results tracked3815

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Olmo 3.1 32b Think leads

Amazon Nova Pro: 35.1 (#229), Olmo 3.1 32b Think: 37.7 (#189)

BenchmarkAmazon Nova ProOlmo 3.1 32b Think
LMArena Coding12701291
LiveBench Coding38.1%—

Agentic & Tool Use Not comparable

Amazon Nova Pro: 16.7 (#147), Olmo 3.1 32b Think: —

BenchmarkAmazon Nova ProOlmo 3.1 32b Think
Berkeley Function Calling Leaderboard25%—
TheAgentCompany1.7%—

Reasoning Olmo 3.1 32b Think leads

Amazon Nova Pro: 20.0 (#243), Olmo 3.1 32b Think: 25.2 (#150)

BenchmarkAmazon Nova ProOlmo 3.1 32b Think
LMArena Hard Prompts12461272
LiveBench Reasoning32.6%—
LiveBench Data Analysis48.3%—
Epoch Capabilities Index123.8—
LiveBench43.5%—

Math Olmo 3.1 32b Think leads

Amazon Nova Pro: 28.5 (#243), Olmo 3.1 32b Think: 36.3 (#168)

BenchmarkAmazon Nova ProOlmo 3.1 32b Think
LMArena Math12521305
Omni-MATH24.2%—
LiveBench Math38%—

Knowledge Olmo 3.1 32b Think leads

Amazon Nova Pro: 27.4 (#250), Olmo 3.1 32b Think: 35.7 (#181)

BenchmarkAmazon Nova ProOlmo 3.1 32b Think
LMArena Expert12111295
Humanity's Last Exam4.4%—
MMLU-Pro67.3%—
Confabulations30.1%—
Vectara Hallucination Rate5.1%—
GPQA (HELM)44.6%—
MMLU82%—

Multimodal Not comparable

Amazon Nova Pro: 25.0 (#126), Olmo 3.1 32b Think: —

BenchmarkAmazon Nova ProOlmo 3.1 32b Think
LMArena Vision980—

Multilingual Amazon Nova Pro leads

Amazon Nova Pro: 39.7 (#223), Olmo 3.1 32b Think: 38.1 (#231)

BenchmarkAmazon Nova ProOlmo 3.1 32b Think
LMArena Non-English12341209
LMArena Chinese12441242
LMArena French12711260
LMArena German12431262
LMArena Russian12401193
LMArena Spanish11821289
LMArena Japanese1200—
LMArena Korean1203—

Instruction Following Too close to call

Amazon Nova Pro: 64.9 (#226), Olmo 3.1 32b Think: 65.6 (#218)

BenchmarkAmazon Nova ProOlmo 3.1 32b Think
LMArena Instruction Following12351247
LiveBench Instruction Following67.1%—
IFEval81.5%—

Long Context Too close to call

Amazon Nova Pro: 38.1 (#205), Olmo 3.1 32b Think: 38.6 (#195)

BenchmarkAmazon Nova ProOlmo 3.1 32b Think
LMArena Longer Query12551272

Writing & Preference Olmo 3.1 32b Think leads

Amazon Nova Pro: 43.9 (#226), Olmo 3.1 32b Think: 46.2 (#220)

BenchmarkAmazon Nova ProOlmo 3.1 32b Think
LMArena Text12591272
LMArena Creative Writing12121226
LMArena Multi-Turn12461252
Short-Story Creative Writing60.5%—
WildBench77.7%—
LiveBench Language37%—

Frequently asked questions

Is Amazon Nova Pro better than Olmo 3.1 32b Think?

Olmo 3.1 32b Think is the stronger model overall, scoring 37.9 to 31.0 on the Noometry Index.

Is Amazon Nova Pro or Olmo 3.1 32b Think better for coding?

Olmo 3.1 32b Think scores higher on coding benchmarks: 37.7 versus 35.1 in the Noometry coding category.

How many benchmarks do Amazon Nova Pro and Olmo 3.1 32b Think share?

15 benchmarks have published results for both models. Amazon Nova Pro has 38 scored results on Noometry and Olmo 3.1 32b Think has 15.

Related comparisons

Go deeper