Model comparison

Llama 13b vs Nova Premier 1.0

Nova Premier 1.0 is the stronger model overall, scoring 38.3 to 24.4 on the Noometry Index.

Last verified . 0 shared benchmarks.

Llama 13b Meta

24.4

Rank #348 Confirmed

Nova Premier 1.0 Amazon

38.3

Rank #189 Confirmed

Summary

  • The widest gap is in writing & preference, where Nova Premier 1.0 leads 51.0 to 13.8.
  • Llama 13b has downloadable open weights; the other is API-only.

Side by side

Llama 13b and Nova Premier 1.0 specifications
Llama 13bNova Premier 1.0
ProviderMetaAmazon
Noometry Index24.438.3
Released2023-02-242025-04-30
WeightsOpenProprietary
Context window—1M
Max output—10K
Input $ / M tokens—$2.50
Output $ / M tokens—$12.50
Results tracked216

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 13b: 21.4 (#337), Nova Premier 1.0: —

Coding benchmarks
BenchmarkLlama 13bNova Premier 1.0
LMArena Coding683—

Reasoning Nova Premier 1.0 leads

Llama 13b: 14.0 (#329), Nova Premier 1.0: 23.0 (#185)

Reasoning benchmarks
BenchmarkLlama 13bNova Premier 1.0
Kagi LLM Benchmark—44.8%
LMArena Hard Prompts728—
BIG-Bench Hard37.9%—
Epoch Capabilities Index100.58—
HellaSwag79.2%—
LAMBADA75.2%—
PIQA80.1%—
WinoGrande73%—

Math Nova Premier 1.0 leads

Llama 13b: 26.7 (#256), Nova Premier 1.0: 33.8 (#199)

Math benchmarks
BenchmarkLlama 13bNova Premier 1.0
Omni-MATH—35%
LMArena Math838—
GSM8K20.6%—

Knowledge Not comparable

Llama 13b: —, Nova Premier 1.0: 35.8 (#180)

Knowledge benchmarks
BenchmarkLlama 13bNova Premier 1.0
MMLU-Pro—72.6%
GPQA (HELM)—51.8%
ARC (AI2) Challenge52.7%—
BoolQ78.7%—
MMLU47.7%—
OpenBookQA56.4%—
TriviaQA77.9%—

Multimodal Not comparable

Llama 13b: —, Nova Premier 1.0: —

Multimodal benchmarks
BenchmarkLlama 13bNova Premier 1.0
ScienceQA43.3%—

Multilingual Not comparable

Llama 13b: 16.6 (#297), Nova Premier 1.0: —

Multilingual benchmarks
BenchmarkLlama 13bNova Premier 1.0
LMArena Non-English819—

Instruction Following Nova Premier 1.0 leads

Llama 13b: 36.7 (#305), Nova Premier 1.0: 66.8 (#204)

Instruction Following benchmarks
BenchmarkLlama 13bNova Premier 1.0
IFEval—80.3%
LMArena Instruction Following781—

Writing & Preference Nova Premier 1.0 leads

Llama 13b: 13.8 (#312), Nova Premier 1.0: 51.0 (#178)

Writing & Preference benchmarks
BenchmarkLlama 13bNova Premier 1.0
LMArena Text834—
LMArena Creative Writing794—
WildBench—78.8%
LMArena Multi-Turn753—

Frequently asked questions

Is Llama 13b better than Nova Premier 1.0?

Nova Premier 1.0 is the stronger model overall, scoring 38.3 to 24.4 on the Noometry Index.

How many benchmarks do Llama 13b and Nova Premier 1.0 share?

0 benchmarks have published results for both models. Llama 13b has 21 scored results on Noometry and Nova Premier 1.0 has 6.

Related comparisons

Go deeper