Model comparison

Llama 3-70B vs Nova 2.0 Pro Preview

Nova 2.0 Pro Preview is the stronger model overall, scoring 33.4 to 28.8 on the Noometry Index.

Last verified . 0 shared benchmarks.

Llama 3-70B Meta

28.8

Rank #323 Confirmed

Nova 2.0 Pro Preview Amazon

33.4

Rank #244 Reported

Summary

  • The widest gap is in coding, where Nova 2.0 Pro Preview leads 40.8 to 35.8.
  • Llama 3-70B has downloadable open weights; the other is API-only.

Side by side

Llama 3-70B and Nova 2.0 Pro Preview specifications
Llama 3-70BNova 2.0 Pro Preview
ProviderMetaAmazon
Noometry Index28.833.4
Released2024-04-182025-12-02
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked313

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Nova 2.0 Pro Preview leads

Llama 3-70B: 35.8 (#218), Nova 2.0 Pro Preview: 40.8 (#133)

Coding benchmarks
BenchmarkLlama 3-70BNova 2.0 Pro Preview
SciCode—42.7%
BigCodeBench Instruct43.6%—
LMArena Coding1206—
BigCodeBench Complete54.5%—
HumanEval+72%—
MBPP+69%—

Agentic & Tool Use Too close to call

Llama 3-70B: 21.1 (#139), Nova 2.0 Pro Preview: 21.9 (#136)

Agentic & Tool Use benchmarks
BenchmarkLlama 3-70BNova 2.0 Pro Preview
Cybench5%—
GDP.pdf—2%

Reasoning Nova 2.0 Pro Preview leads

Llama 3-70B: 18.0 (#288), Nova 2.0 Pro Preview: 22.4 (#194)

Reasoning benchmarks
BenchmarkLlama 3-70BNova 2.0 Pro Preview
Kagi LLM Benchmark35.1%—
CritPt—0%
LMArena Hard Prompts1195—
DTBench54.2%—
Epoch Capabilities Index122.93—
ForecastBench57.1—
WinoGrande83.5%—

Math Not comparable

Llama 3-70B: 12.8 (#305), Nova 2.0 Pro Preview: —

Math benchmarks
BenchmarkLlama 3-70BNova 2.0 Pro Preview
OTIS Mock AIME 2024-20254.3%—
LMArena Math1218—
MATH Level 522.6%—

Knowledge Not comparable

Llama 3-70B: 20.8 (#277), Nova 2.0 Pro Preview: —

Knowledge benchmarks
BenchmarkLlama 3-70BNova 2.0 Pro Preview
GPQA Diamond40.6%—
LMArena Expert1149—
MMLU79.3%—

Multilingual Not comparable

Llama 3-70B: 33.6 (#251), Nova 2.0 Pro Preview: —

Multilingual benchmarks
BenchmarkLlama 3-70BNova 2.0 Pro Preview
LMArena Non-English1142—
LMArena Chinese1114—
LMArena French1232—
LMArena German1169—
LMArena Japanese1017—
LMArena Korean1017—
LMArena Russian1159—
LMArena Spanish1241—

Instruction Following Not comparable

Llama 3-70B: 62.5 (#238), Nova 2.0 Pro Preview: —

Instruction Following benchmarks
BenchmarkLlama 3-70BNova 2.0 Pro Preview
LMArena Instruction Following1194—

Long Context Not comparable

Llama 3-70B: 35.6 (#240), Nova 2.0 Pro Preview: —

Long Context benchmarks
BenchmarkLlama 3-70BNova 2.0 Pro Preview
LMArena Longer Query1174—

Writing & Preference Not comparable

Llama 3-70B: 42.8 (#231), Nova 2.0 Pro Preview: —

Writing & Preference benchmarks
BenchmarkLlama 3-70BNova 2.0 Pro Preview
LMArena Text1221—
LMArena Creative Writing1210—
LMArena Multi-Turn1223—

Frequently asked questions

Is Llama 3-70B better than Nova 2.0 Pro Preview?

Nova 2.0 Pro Preview is the stronger model overall, scoring 33.4 to 28.8 on the Noometry Index.

Is Llama 3-70B or Nova 2.0 Pro Preview better for coding?

Nova 2.0 Pro Preview scores higher on coding benchmarks: 40.8 versus 35.8 in the Noometry coding category.

How many benchmarks do Llama 3-70B and Nova 2.0 Pro Preview share?

0 benchmarks have published results for both models. Llama 3-70B has 31 scored results on Noometry and Nova 2.0 Pro Preview has 3.

Related comparisons

Go deeper