Model comparison

GPT-5 Pro vs Llama 13b

GPT-5 Pro is the stronger model overall, scoring 46.4 to 24.4 on the Noometry Index.

Last verified . 1 shared benchmarks.

GPT-5 Pro OpenAI

46.4

Rank #64 Confirmed

Llama 13b Meta

24.4

Rank #348 Confirmed

Summary

  • They share 1 benchmark with published results for both. GPT-5 Pro scores higher in 3 categories and Llama 13b in 0 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where GPT-5 Pro leads 38.9 to 14.0.
  • Llama 13b has downloadable open weights; the other is API-only.

Side by side

GPT-5 Pro and Llama 13b specifications
GPT-5 ProLlama 13b
ProviderOpenAIMeta
Noometry Index46.424.4
Released2025-10-062023-02-24
WeightsProprietaryOpen
Context window400K—
Max output272K—
Input $ / M tokens$15—
Output $ / M tokens$120—
Results tracked1221

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5 Pro leads

GPT-5 Pro: 44.0 (#80), Llama 13b: 21.4 (#337)

Coding benchmarks
BenchmarkGPT-5 ProLlama 13b
WeirdML60.4%—
LMArena Coding—683
AlgoTune1.31—

Reasoning GPT-5 Pro leads

GPT-5 Pro: 38.9 (#62), Llama 13b: 14.0 (#329)

Reasoning benchmarks
BenchmarkGPT-5 ProLlama 13b
Epoch Capabilities Index150.28100.58
ARC-AGI-218.3%—
SimpleBench61.6%—
Kagi LLM Benchmark76.8%—
ARC-AGI-170.2%—
EnigmaEval18.8%—
LMArena Hard Prompts—728
BIG-Bench Hard—37.9%
HellaSwag—79.2%
LAMBADA—75.2%
PIQA—80.1%
WinoGrande—73%

Math GPT-5 Pro leads

GPT-5 Pro: 48.5 (#63), Llama 13b: 26.7 (#256)

Math benchmarks
BenchmarkGPT-5 ProLlama 13b
FrontierMath (Tiers 1-3)55.8%—
FrontierMath Tier 419.5%—
LMArena Math—838
FrontierMath Tier 4 (v1)14.6%—
GSM8K—20.6%

Knowledge Not comparable

GPT-5 Pro: 56.7 (#42), Llama 13b: —

Knowledge benchmarks
BenchmarkGPT-5 ProLlama 13b
Humanity's Last Exam31.6%—
ARC (AI2) Challenge—52.7%
BoolQ—78.7%
MMLU—47.7%
OpenBookQA—56.4%
TriviaQA—77.9%

Multimodal Not comparable

GPT-5 Pro: —, Llama 13b: —

Multimodal benchmarks
BenchmarkGPT-5 ProLlama 13b
ScienceQA—43.3%

Multilingual Not comparable

GPT-5 Pro: —, Llama 13b: 16.6 (#297)

Multilingual benchmarks
BenchmarkGPT-5 ProLlama 13b
LMArena Non-English—819

Instruction Following Not comparable

GPT-5 Pro: —, Llama 13b: 36.7 (#305)

Instruction Following benchmarks
BenchmarkGPT-5 ProLlama 13b
LMArena Instruction Following—781

Writing & Preference Not comparable

GPT-5 Pro: —, Llama 13b: 13.8 (#312)

Writing & Preference benchmarks
BenchmarkGPT-5 ProLlama 13b
LMArena Text—834
LMArena Creative Writing—794
LMArena Multi-Turn—753

Frequently asked questions

Is GPT-5 Pro better than Llama 13b?

GPT-5 Pro is the stronger model overall, scoring 46.4 to 24.4 on the Noometry Index.

Is GPT-5 Pro or Llama 13b better for coding?

GPT-5 Pro scores higher on coding benchmarks: 44.0 versus 21.4 in the Noometry coding category.

How many benchmarks do GPT-5 Pro and Llama 13b share?

1 benchmark has published results for both models. GPT-5 Pro has 12 scored results on Noometry and Llama 13b has 21.

Related comparisons

Go deeper