Model comparison

Amazon Nova Micro vs Claude 2

Amazon Nova Micro is the stronger model overall, scoring 30.4 to 25.0 on the Noometry Index.

Last verified . 1 shared benchmarks.

Amazon Nova Micro Amazon

30.4

Rank #294 Confirmed

Claude 2 Anthropic

25.0

Rank #346 Reported

Summary

  • They share 1 benchmark with published results for both. Amazon Nova Micro scores higher in 2 categories and Claude 2 in 1 category; 3 gaps are clear of the uncertainty.
  • The widest gap is in math, where Amazon Nova Micro leads 26.9 to 9.3.

Side by side

Amazon Nova Micro and Claude 2 specifications
Amazon Nova MicroClaude 2
ProviderAmazonAnthropic
Noometry Index30.425.0
Released2024-12-032023-07-11
WeightsProprietaryProprietary
Context window128K—
Max output10K—
Input $ / M tokens$0.035—
Output $ / M tokens$0.14—
Results tracked328

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Amazon Nova Micro: 30.5 (#295), Claude 2: —

Coding benchmarks
BenchmarkAmazon Nova MicroClaude 2
LiveBench Coding20.2%—
LMArena Coding1218—
HumanEval+—61.6%

Agentic & Tool Use Not comparable

Amazon Nova Micro: 22.1 (#132), Claude 2: —

Agentic & Tool Use benchmarks
BenchmarkAmazon Nova MicroClaude 2
Berkeley Function Calling Leaderboard22.3%—

Reasoning Claude 2 leads

Amazon Nova Micro: 17.4 (#294), Claude 2: 21.7 (#216)

Reasoning benchmarks
BenchmarkAmazon Nova MicroClaude 2
LiveBench Reasoning25.1%—
LMArena Hard Prompts1191—
DTBench—51.9%
LiveBench Data Analysis34%—
Epoch Capabilities Index—120.13
LiveBench29.6%—

Math Amazon Nova Micro leads

Amazon Nova Micro: 26.9 (#254), Claude 2: 9.3 (#320)

Math benchmarks
BenchmarkAmazon Nova MicroClaude 2
OTIS Mock AIME 2024-2025—2.5%
Omni-MATH21.4%—
LiveBench Math34.5%—
LMArena Math1206—
MATH Level 5—11.7%

Knowledge Amazon Nova Micro leads

Amazon Nova Micro: 29.6 (#237), Claude 2: 16.9 (#287)

Knowledge benchmarks
BenchmarkAmazon Nova MicroClaude 2
MMLU70.8%78.5%
GPQA Diamond—34.7%
MMLU-Pro51.1%—
Vectara Hallucination Rate5.5%—
GPQA (HELM)38.3%—
LMArena Expert1184—
TriviaQA—87.5%

Multilingual Not comparable

Amazon Nova Micro: 36.5 (#239), Claude 2: —

Multilingual benchmarks
BenchmarkAmazon Nova MicroClaude 2
LMArena Non-English1186—
LMArena Chinese1209—
LMArena French1238—
LMArena German1192—
LMArena Japanese1154—
LMArena Korean1150—
LMArena Russian1185—
LMArena Spanish1225—

Instruction Following Not comparable

Amazon Nova Micro: 56.3 (#272), Claude 2: —

Instruction Following benchmarks
BenchmarkAmazon Nova MicroClaude 2
LiveBench Instruction Following48%—
IFEval76%—
LMArena Instruction Following1174—

Long Context Not comparable

Amazon Nova Micro: 36.5 (#229), Claude 2: —

Long Context benchmarks
BenchmarkAmazon Nova MicroClaude 2
LMArena Longer Query1205—

Writing & Preference Not comparable

Amazon Nova Micro: 39.5 (#247), Claude 2: —

Writing & Preference benchmarks
BenchmarkAmazon Nova MicroClaude 2
LMArena Text1208—
LMArena Creative Writing1172—
WildBench74.3%—
LMArena Multi-Turn1178—
LiveBench Language15.8%—

Frequently asked questions

Is Amazon Nova Micro better than Claude 2?

Amazon Nova Micro is the stronger model overall, scoring 30.4 to 25.0 on the Noometry Index.

How many benchmarks do Amazon Nova Micro and Claude 2 share?

1 benchmark has published results for both models. Amazon Nova Micro has 32 scored results on Noometry and Claude 2 has 8.

Related comparisons

Go deeper