Noometry

Model comparison

Amazon Nova Micro vs Llama 2-13B

Amazon Nova Micro and Llama 2-13B score almost the same on the Noometry Index (30.4 vs 29.6), so choose on price, context window or the category you care about most.

Last verified . 18 shared benchmarks.

Amazon Nova Micro Amazon

30.4

Rank #294 Confirmed

Llama 2-13B Meta

29.6

Rank #309 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Amazon Nova Micro scores higher in 6 categories and Llama 2-13B in 2 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where Amazon Nova Micro leads 36.5 to 26.5.
  • Llama 2-13B has downloadable open weights; the other is API-only.

Side by side

Amazon Nova MicroLlama 2-13B
ProviderAmazonMeta
Noometry Index30.429.6
Released2024-12-032023-07-18
WeightsProprietaryOpen
Context window128K—
Max output10K—
Input $ / M tokens$0.035—
Output $ / M tokens$0.14—
Results tracked3232

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Amazon Nova Micro: 30.5 (#295), Llama 2-13B: 30.9 (#291)

BenchmarkAmazon Nova MicroLlama 2-13B
LMArena Coding12181062
LiveBench Coding20.2%—

Agentic & Tool Use Not comparable

Amazon Nova Micro: 22.1 (#132), Llama 2-13B: —

BenchmarkAmazon Nova MicroLlama 2-13B
Berkeley Function Calling Leaderboard22.3%—

Reasoning Amazon Nova Micro leads

Amazon Nova Micro: 17.4 (#294), Llama 2-13B: 12.8 (#337)

BenchmarkAmazon Nova MicroLlama 2-13B
LMArena Hard Prompts11911051
Chess Puzzles—0%
LiveBench Reasoning25.1%—
DTBench—42.2%
LiveBench Data Analysis34%—
BIG-Bench Hard—58.2%
Epoch Capabilities Index—106.17
HellaSwag—80.7%
LAMBADA—76.5%
LiveBench29.6%—
PIQA—80.8%
WinoGrande—72.8%

Math Llama 2-13B leads

Amazon Nova Micro: 26.9 (#254), Llama 2-13B: 31.1 (#229)

BenchmarkAmazon Nova MicroLlama 2-13B
LMArena Math12061065
Omni-MATH21.4%—
LiveBench Math34.5%—
GSM8K—36.9%

Knowledge Amazon Nova Micro leads

Amazon Nova Micro: 29.6 (#237), Llama 2-13B: 28.1 (#249)

BenchmarkAmazon Nova MicroLlama 2-13B
LMArena Expert11841030
MMLU70.8%55.6%
MMLU-Pro51.1%—
Vectara Hallucination Rate5.5%—
GPQA (HELM)38.3%—
ARC (AI2) Challenge—60.3%
BoolQ—82.4%
OpenBookQA—57%
TriviaQA—79.6%

Multimodal Not comparable

Amazon Nova Micro: —, Llama 2-13B: —

BenchmarkAmazon Nova MicroLlama 2-13B
ScienceQA—55.8%

Multilingual Amazon Nova Micro leads

Amazon Nova Micro: 36.5 (#239), Llama 2-13B: 26.5 (#279)

BenchmarkAmazon Nova MicroLlama 2-13B
LMArena Non-English11861024
LMArena Chinese12091001
LMArena French12381044
LMArena German11921009
LMArena Japanese1154894
LMArena Korean1150953
LMArena Russian11851055
LMArena Spanish12251087

Instruction Following Amazon Nova Micro leads

Amazon Nova Micro: 56.3 (#272), Llama 2-13B: 53.3 (#287)

BenchmarkAmazon Nova MicroLlama 2-13B
LMArena Instruction Following11741045
LiveBench Instruction Following48%—
IFEval76%—

Long Context Amazon Nova Micro leads

Amazon Nova Micro: 36.5 (#229), Llama 2-13B: 32.3 (#269)

BenchmarkAmazon Nova MicroLlama 2-13B
LMArena Longer Query12051064

Writing & Preference Amazon Nova Micro leads

Amazon Nova Micro: 39.5 (#247), Llama 2-13B: 29.8 (#289)

BenchmarkAmazon Nova MicroLlama 2-13B
LMArena Text12081084
LMArena Creative Writing11721047
LMArena Multi-Turn11781050
WildBench74.3%—
LiveBench Language15.8%—

Frequently asked questions

Is Amazon Nova Micro better than Llama 2-13B?

Amazon Nova Micro and Llama 2-13B score almost the same on the Noometry Index (30.4 vs 29.6), so choose on price, context window or the category you care about most.

Is Amazon Nova Micro or Llama 2-13B better for coding?

They score almost the same on coding (30.5 vs 30.9); test both on your own repository before choosing.

How many benchmarks do Amazon Nova Micro and Llama 2-13B share?

18 benchmarks have published results for both models. Amazon Nova Micro has 32 scored results on Noometry and Llama 2-13B has 32.

Related comparisons

Go deeper