Noometry

Model comparison

Amazon Nova Micro vs Llama 3.1-8B

Amazon Nova Micro is the stronger model overall, scoring 30.4 to 23.0 on the Noometry Index.

Last verified . 24 shared benchmarks.

Amazon Nova Micro Amazon

30.4

Rank #294 Confirmed

Llama 3.1-8B Meta

23.0

Rank #352 Confirmed

Summary

  • They share 24 benchmarks with published results for both. Amazon Nova Micro scores higher in 7 categories and Llama 3.1-8B in 2 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Amazon Nova Micro leads 29.6 to 8.0.
  • The biggest single-benchmark swing is GPQA (HELM): 38.3% for Amazon Nova Micro and 24.7% for Llama 3.1-8B.
  • Llama 3.1-8B is cheaper at $0.05 / $0.08 per million input/output tokens, against $0.035 / $0.14 for Amazon Nova Micro.
  • Llama 3.1-8B has downloadable open weights; the other is API-only.

Side by side

Amazon Nova MicroLlama 3.1-8B
ProviderAmazonMeta
Noometry Index30.423.0
Released2024-12-032024-07-23
WeightsProprietaryOpen
Context window128K128K
Max output10K4K
Input $ / M tokens$0.035$0.05
Output $ / M tokens$0.14$0.08
Results tracked3243

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Amazon Nova Micro leads

Amazon Nova Micro: 30.5 (#295), Llama 3.1-8B: 20.2 (#340)

BenchmarkAmazon Nova MicroLlama 3.1-8B
LMArena Coding12181195
SciCode—13.2%
WeirdML—1.7%
BigCodeBench Instruct—32.8%
LiveBench Coding20.2%—
BigCodeBench Complete—40.5%
HumanEval+—62.8%
MBPP+—55.6%

Agentic & Tool Use Too close to call

Amazon Nova Micro: 22.1 (#132), Llama 3.1-8B: 22.5 (#131)

BenchmarkAmazon Nova MicroLlama 3.1-8B
Berkeley Function Calling Leaderboard22.3%25.8%
BALROG—15.1%

Reasoning Amazon Nova Micro leads

Amazon Nova Micro: 17.4 (#294), Llama 3.1-8B: 14.9 (#321)

BenchmarkAmazon Nova MicroLlama 3.1-8B
LMArena Hard Prompts11911175
CritPt—0%
Chess Puzzles—0%
LiveBench Reasoning25.1%—
DTBench—50.9%
LiveBench Data Analysis34%—
LMCA—5.4%
Epoch Capabilities Index—116.57
LiveBench29.6%—
PIQA—81.2%

Math Amazon Nova Micro leads

Amazon Nova Micro: 26.9 (#254), Llama 3.1-8B: 10.2 (#317)

BenchmarkAmazon Nova MicroLlama 3.1-8B
Omni-MATH21.4%13.7%
LMArena Math12061179
OTIS Mock AIME 2024-2025—1.7%
LiveBench Math34.5%—
MATH Level 5—22.9%
GSM8K—82.4%

Knowledge Amazon Nova Micro leads

Amazon Nova Micro: 29.6 (#237), Llama 3.1-8B: 8.0 (#307)

BenchmarkAmazon Nova MicroLlama 3.1-8B
MMLU-Pro51.1%40.6%
GPQA (HELM)38.3%24.7%
LMArena Expert11841144
MMLU70.8%56.1%
GPQA Diamond—27%
Vectara Hallucination Rate5.5%—
BoolQ—82.8%

Multilingual Amazon Nova Micro leads

Amazon Nova Micro: 36.5 (#239), Llama 3.1-8B: 34.0 (#249)

BenchmarkAmazon Nova MicroLlama 3.1-8B
LMArena Non-English11861148
LMArena Chinese12091151
LMArena French12381177
LMArena German11921144
LMArena Japanese11541061
LMArena Korean11501053
LMArena Russian11851158
LMArena Spanish12251169

Instruction Following Llama 3.1-8B leads

Amazon Nova Micro: 56.3 (#272), Llama 3.1-8B: 58.9 (#258)

BenchmarkAmazon Nova MicroLlama 3.1-8B
IFEval76%74.3%
LMArena Instruction Following11741159
LiveBench Instruction Following48%—

Long Context Too close to call

Amazon Nova Micro: 36.5 (#229), Llama 3.1-8B: 35.8 (#238)

BenchmarkAmazon Nova MicroLlama 3.1-8B
LMArena Longer Query12051182

Writing & Preference Amazon Nova Micro leads

Amazon Nova Micro: 39.5 (#247), Llama 3.1-8B: 29.7 (#290)

BenchmarkAmazon Nova MicroLlama 3.1-8B
LMArena Text12081187
LMArena Creative Writing11721154
WildBench74.3%68.7%
LMArena Multi-Turn11781172
EQ-Bench Creative Writing—713
LiveBench Language15.8%—

Frequently asked questions

Is Amazon Nova Micro better than Llama 3.1-8B?

Amazon Nova Micro is the stronger model overall, scoring 30.4 to 23.0 on the Noometry Index.

Which is cheaper, Amazon Nova Micro or Llama 3.1-8B?

Llama 3.1-8B is cheaper. It lists at $0.05 per million input tokens and $0.08 per million output tokens; Amazon Nova Micro lists at $0.035 and $0.14.

Is Amazon Nova Micro or Llama 3.1-8B better for coding?

Amazon Nova Micro scores higher on coding benchmarks: 30.5 versus 20.2 in the Noometry coding category.

Which has the bigger context window?

Both accept 128K tokens.

How many benchmarks do Amazon Nova Micro and Llama 3.1-8B share?

24 benchmarks have published results for both models. Amazon Nova Micro has 32 scored results on Noometry and Llama 3.1-8B has 43.

Related comparisons

Go deeper