Model comparison

Amazon Nova Pro vs C4ai Aya Expanse 32b

C4ai Aya Expanse 32b is the stronger model overall, scoring 35.9 to 31.0 on the Noometry Index.

Last verified . 18 shared benchmarks.

Amazon Nova Pro Amazon

31.0

Rank #281 Confirmed

C4ai Aya Expanse 32b Cohere

35.9

Rank #221 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Amazon Nova Pro scores higher in 5 categories and C4ai Aya Expanse 32b in 3 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where C4ai Aya Expanse 32b leads 33.2 to 27.4.
  • The biggest single-benchmark swing is Vectara Hallucination Rate: 5.1% for Amazon Nova Pro and 10.9% for C4ai Aya Expanse 32b.
  • Amazon Nova Pro accepts more context: 300K tokens versus 128K.
  • C4ai Aya Expanse 32b has downloadable open weights; the other is API-only.

Side by side

Amazon Nova Pro and C4ai Aya Expanse 32b specifications
Amazon Nova ProC4ai Aya Expanse 32b
ProviderAmazonCohere
Noometry Index31.035.9
Released2024-12-032024-10-24
WeightsProprietaryOpen
Context window300K128K
Max output10K4K
Input $ / M tokens$0.80—
Output $ / M tokens$3.20—
Results tracked3818

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Amazon Nova Pro: 35.1 (#229), C4ai Aya Expanse 32b: 34.8 (#231)

Coding benchmarks
BenchmarkAmazon Nova ProC4ai Aya Expanse 32b
LMArena Coding12701197
LiveBench Coding38.1%—

Agentic & Tool Use Not comparable

Amazon Nova Pro: 16.7 (#147), C4ai Aya Expanse 32b: —

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova ProC4ai Aya Expanse 32b
Berkeley Function Calling Leaderboard25%—
TheAgentCompany1.7%—

Reasoning C4ai Aya Expanse 32b leads

Amazon Nova Pro: 20.0 (#243), C4ai Aya Expanse 32b: 23.3 (#180)

Reasoning benchmarks
BenchmarkAmazon Nova ProC4ai Aya Expanse 32b
LMArena Hard Prompts12461193
LiveBench Reasoning32.6%—
LiveBench Data Analysis48.3%—
Epoch Capabilities Index123.8—
LiveBench43.5%—

Math C4ai Aya Expanse 32b leads

Amazon Nova Pro: 28.5 (#243), C4ai Aya Expanse 32b: 34.0 (#197)

Math benchmarks
BenchmarkAmazon Nova ProC4ai Aya Expanse 32b
LMArena Math12521200
Omni-MATH24.2%—
LiveBench Math38%—

Knowledge C4ai Aya Expanse 32b leads

Amazon Nova Pro: 27.4 (#250), C4ai Aya Expanse 32b: 33.2 (#206)

Knowledge benchmarks
BenchmarkAmazon Nova ProC4ai Aya Expanse 32b
Vectara Hallucination Rate5.1%10.9%
LMArena Expert12111182
Humanity's Last Exam4.4%—
MMLU-Pro67.3%—
Confabulations30.1%—
GPQA (HELM)44.6%—
MMLU82%—

Multimodal Not comparable

Amazon Nova Pro: 25.0 (#126), C4ai Aya Expanse 32b: —

Multimodal benchmarks
BenchmarkAmazon Nova ProC4ai Aya Expanse 32b
LMArena Vision980—

Multilingual Amazon Nova Pro leads

Amazon Nova Pro: 39.7 (#223), C4ai Aya Expanse 32b: 38.4 (#230)

Multilingual benchmarks
BenchmarkAmazon Nova ProC4ai Aya Expanse 32b
LMArena Non-English12341213
LMArena Chinese12441211
LMArena French12711248
LMArena German12431199
LMArena Japanese12001163
LMArena Korean12031158
LMArena Russian12401227
LMArena Spanish11821193

Instruction Following Amazon Nova Pro leads

Amazon Nova Pro: 64.9 (#226), C4ai Aya Expanse 32b: 62.6 (#237)

Instruction Following benchmarks
BenchmarkAmazon Nova ProC4ai Aya Expanse 32b
LMArena Instruction Following12351196
LiveBench Instruction Following67.1%—
IFEval81.5%—

Long Context Too close to call

Amazon Nova Pro: 38.1 (#205), C4ai Aya Expanse 32b: 37.2 (#220)

Long Context benchmarks
BenchmarkAmazon Nova ProC4ai Aya Expanse 32b
LMArena Longer Query12551228

Writing & Preference Amazon Nova Pro leads

Amazon Nova Pro: 43.9 (#226), C4ai Aya Expanse 32b: 42.2 (#235)

Writing & Preference benchmarks
BenchmarkAmazon Nova ProC4ai Aya Expanse 32b
LMArena Text12591224
LMArena Creative Writing12121200
LMArena Multi-Turn12461190
Short-Story Creative Writing60.5%—
WildBench77.7%—
LiveBench Language37%—

Frequently asked questions

Is Amazon Nova Pro better than C4ai Aya Expanse 32b?

C4ai Aya Expanse 32b is the stronger model overall, scoring 35.9 to 31.0 on the Noometry Index.

Is Amazon Nova Pro or C4ai Aya Expanse 32b better for coding?

They score almost the same on coding (35.1 vs 34.8); test both on your own repository before choosing.

Which has the bigger context window?

Amazon Nova Pro does, with 300K tokens against 128K.

How many benchmarks do Amazon Nova Pro and C4ai Aya Expanse 32b share?

18 benchmarks have published results for both models. Amazon Nova Pro has 38 scored results on Noometry and C4ai Aya Expanse 32b has 18.

Related comparisons

Go deeper