Model comparison

Amazon Nova Pro vs INTELLECT-1

Amazon Nova Pro has enough public results to be ranked (#278); INTELLECT-1 does not yet, so treat this comparison as directional.

Last verified . 2 shared benchmarks.

Amazon Nova Pro Amazon

30.5

Rank #278 Confirmed

Summary

  • They share 2 benchmarks with published results for both.

Side by side

Amazon Nova Pro and INTELLECT-1 specifications
Amazon Nova ProINTELLECT-1
ProviderAmazonHugging Face
Noometry Index30.5—
Released2024-12-032024-11-29
WeightsProprietaryProprietary
Context window300K—
Max output10K—
Input $ / M tokens$0.80—
Output $ / M tokens$3.20—
Results tracked387

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Amazon Nova Pro: 34.6 (#224), INTELLECT-1: —

Coding benchmarks
BenchmarkAmazon Nova ProINTELLECT-1
LiveBench Coding38.1%—
LMArena Coding1270—

Agentic & Tool Use Not comparable

Amazon Nova Pro: 16.6 (#139), INTELLECT-1: —

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova ProINTELLECT-1
Berkeley Function Calling Leaderboard25%—
TheAgentCompany1.7%—

Reasoning Not comparable

Amazon Nova Pro: 19.2 (#240), INTELLECT-1: —

Reasoning benchmarks
BenchmarkAmazon Nova ProINTELLECT-1
Epoch Capabilities Index123.75100.38
LiveBench Reasoning32.6%—
LMArena Hard Prompts1246—
LiveBench Data Analysis48.3%—
BIG-Bench Hard—34.9%
HellaSwag—71.4%
LiveBench43.5%—
WinoGrande—65.8%

Math Not comparable

Amazon Nova Pro: 26.4 (#240), INTELLECT-1: —

Math benchmarks
BenchmarkAmazon Nova ProINTELLECT-1
Omni-MATH24.2%—
LiveBench Math38%—
LMArena Math1252—
GSM8K—38.6%

Knowledge Not comparable

Amazon Nova Pro: 27.1 (#246), INTELLECT-1: —

Knowledge benchmarks
BenchmarkAmazon Nova ProINTELLECT-1
MMLU82%49.9%
Humanity's Last Exam4.4%—
MMLU-Pro67.3%—
Confabulations30.1%—
Vectara Hallucination Rate5.1%—
GPQA (HELM)44.6%—
LMArena Expert1211—
ARC (AI2) Challenge—54.5%

Multimodal Not comparable

Amazon Nova Pro: 24.5 (#121), INTELLECT-1: —

Multimodal benchmarks
BenchmarkAmazon Nova ProINTELLECT-1
LMArena Vision980—

Multilingual Not comparable

Amazon Nova Pro: 39.9 (#218), INTELLECT-1: —

Multilingual benchmarks
BenchmarkAmazon Nova ProINTELLECT-1
LMArena Non-English1234—
LMArena Chinese1244—
LMArena French1270—
LMArena German1243—
LMArena Japanese1200—
LMArena Korean1203—
LMArena Russian1240—
LMArena Spanish1182—

Instruction Following Not comparable

Amazon Nova Pro: 65.1 (#221), INTELLECT-1: —

Instruction Following benchmarks
BenchmarkAmazon Nova ProINTELLECT-1
LiveBench Instruction Following67.1%—
IFEval81.5%—
LMArena Instruction Following1235—

Long Context Not comparable

Amazon Nova Pro: 38.1 (#199), INTELLECT-1: —

Long Context benchmarks
BenchmarkAmazon Nova ProINTELLECT-1
LMArena Longer Query1255—

Writing & Preference Not comparable

Amazon Nova Pro: 44.1 (#221), INTELLECT-1: —

Writing & Preference benchmarks
BenchmarkAmazon Nova ProINTELLECT-1
LMArena Text1259—
LMArena Creative Writing1212—
Short-Story Creative Writing60.5%—
WildBench77.7%—
LMArena Multi-Turn1245—
LiveBench Language37%—

Frequently asked questions

Is Amazon Nova Pro better than INTELLECT-1?

Amazon Nova Pro has enough public results to be ranked (#278); INTELLECT-1 does not yet, so treat this comparison as directional.

How many benchmarks do Amazon Nova Pro and INTELLECT-1 share?

2 benchmarks have published results for both models. Amazon Nova Pro has 38 scored results on Noometry and INTELLECT-1 has 7.

Related comparisons

Go deeper