Model comparison

GPT-5.2 vs Llama 13b

GPT-5.2 is the stronger model overall, scoring 54.1 to 24.4 on the Noometry Index.

Last verified . 9 shared benchmarks.

GPT-5.2 OpenAI

54.1

Rank #34 Confirmed

Llama 13b Meta

24.4

Rank #348 Confirmed

Summary

  • They share 9 benchmarks with published results for both. GPT-5.2 scores higher in 6 categories and Llama 13b in 0 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where GPT-5.2 leads 66.8 to 13.8.
  • Llama 13b has downloadable open weights; the other is API-only.

Side by side

GPT-5.2 and Llama 13b specifications
GPT-5.2Llama 13b
ProviderOpenAIMeta
Noometry Index54.124.4
Released2025-12-112023-02-24
WeightsProprietaryOpen
Context window400K—
Max output128K—
Input $ / M tokens$1.75—
Output $ / M tokens$14—
Results tracked6721

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.2 leads

GPT-5.2: 51.6 (#37), Llama 13b: 21.4 (#337)

Coding benchmarks
BenchmarkGPT-5.2Llama 13b
LMArena Coding1447683
SWE-bench Verified73.8%—
SWE-bench Verified (bash only)72.8%—
LMArena WebDev1416—
SWE-bench Multilingual66.7%—
GSO27.4%—
WeirdML72.2%—
ALE-Bench1,294—
AlgoTune2.05—

Agentic & Tool Use Not comparable

GPT-5.2: 40.2 (#24), Llama 13b: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.2Llama 13b
Terminal-Bench64.9%—
Berkeley Function Calling Leaderboard55.9%—
GDPval49.7%—
Remote Labor Index2.5%—
τ²-bench Airline83%—
τ²-bench Banking32.2%—
τ²-bench Retail81.6%—
τ²-bench Telecom89.7%—
DeepResearch Bench41.1%—
LMArena Search1207—
METR Time Horizons75.3%—
Vending-Bench 23,591—

Reasoning GPT-5.2 leads

GPT-5.2: 50.2 (#35), Llama 13b: 14.0 (#329)

Reasoning benchmarks
BenchmarkGPT-5.2Llama 13b
LMArena Hard Prompts1445728
Epoch Capabilities Index153.45100.58
ARC-AGI-252.9%—
SimpleBench45.8%—
Kagi LLM Benchmark73.3%—
NYT Connections (extended)83.6%—
ARC-AGI-186.2%—
Chess Puzzles49%—
EnigmaEval10.4%—
EBR-Bench23%—
Mystery Game Puzzles23%—
DTBench90.9%—
LMCA43.9%—
BIG-Bench Hard—37.9%
ForecastBench60.1—
HellaSwag—79.2%
LAMBADA—75.2%
PIQA—80.1%
WinoGrande—73%

Math GPT-5.2 leads

GPT-5.2: 60.0 (#38), Llama 13b: 26.7 (#256)

Knowledge Not comparable

GPT-5.2: 59.3 (#32), Llama 13b: —

Knowledge benchmarks
BenchmarkGPT-5.2Llama 13b
GPQA Diamond91.4%—
Humanity's Last Exam27.8%—
SimpleQA Verified37.1%—
Vectara Hallucination Rate8.4%—
LMArena Expert1445—
ARC (AI2) Challenge—52.7%
BoolQ—78.7%
MMLU—47.7%
OpenBookQA—56.4%
TriviaQA—77.9%

Multimodal Not comparable

GPT-5.2: 51.3 (#7), Llama 13b: —

Multimodal benchmarks
BenchmarkGPT-5.2Llama 13b
LMArena Vision1268—
VPCT84%—
Furniture Assembly38.3%—
LMArena Document1405—
ScienceQA—43.3%

Multilingual GPT-5.2 leads

GPT-5.2: 53.4 (#67), Llama 13b: 16.6 (#297)

Multilingual benchmarks
BenchmarkGPT-5.2Llama 13b
LMArena Non-English1425819
LMArena Chinese1460—
LMArena French1455—
LMArena German1448—
LMArena Japanese1420—
LMArena Korean1392—
LMArena Russian1440—
LMArena Spanish1433—

Instruction Following GPT-5.2 leads

GPT-5.2: 74.7 (#89), Llama 13b: 36.7 (#305)

Instruction Following benchmarks
BenchmarkGPT-5.2Llama 13b
LMArena Instruction Following1417781

Long Context Not comparable

GPT-5.2: 44.0 (#78), Llama 13b: —

Long Context benchmarks
BenchmarkGPT-5.2Llama 13b
CL-bench18.2%—
LMArena Longer Query1428—

Writing & Preference GPT-5.2 leads

GPT-5.2: 66.8 (#32), Llama 13b: 13.8 (#312)

Writing & Preference benchmarks
BenchmarkGPT-5.2Llama 13b
LMArena Text1439834
LMArena Creative Writing1401794
LMArena Multi-Turn1458753
EQ-Bench Creative Writing1703—

Frequently asked questions

Is GPT-5.2 better than Llama 13b?

GPT-5.2 is the stronger model overall, scoring 54.1 to 24.4 on the Noometry Index.

Is GPT-5.2 or Llama 13b better for coding?

GPT-5.2 scores higher on coding benchmarks: 51.6 versus 21.4 in the Noometry coding category.

How many benchmarks do GPT-5.2 and Llama 13b share?

9 benchmarks have published results for both models. GPT-5.2 has 67 scored results on Noometry and Llama 13b has 21.

Related comparisons

Go deeper