Model comparison

GPT-5.2 Codex vs Llama 3-70B

GPT-5.2 Codex is the stronger model overall, scoring 42.6 to 28.8 on the Noometry Index.

Last verified . 0 shared benchmarks.

GPT-5.2 Codex OpenAI

42.6

Rank #111 Reported

Llama 3-70B Meta

28.8

Rank #323 Confirmed

Summary

  • The widest gap is in agentic & tool use, where GPT-5.2 Codex leads 41.0 to 21.1.
  • Llama 3-70B has downloadable open weights; the other is API-only.

Side by side

GPT-5.2 Codex and Llama 3-70B specifications
GPT-5.2 CodexLlama 3-70B
ProviderOpenAIMeta
Noometry Index42.628.8
Released2025-12-182024-04-18
WeightsProprietaryOpen
Context window400K—
Max output128K—
Input $ / M tokens$1.75—
Output $ / M tokens$14—
Results tracked531

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.2 Codex leads

GPT-5.2 Codex: 45.5 (#71), Llama 3-70B: 35.8 (#218)

Coding benchmarks
BenchmarkGPT-5.2 CodexLlama 3-70B
SWE-bench Verified (bash only)72.8%—
LMArena WebDev1339—
SWE-bench Multilingual66.3%—
BigCodeBench Instruct—43.6%
LMArena Coding—1206
BigCodeBench Complete—54.5%
ALE-Bench1,300—
HumanEval+—72%
MBPP+—69%

Agentic & Tool Use GPT-5.2 Codex leads

GPT-5.2 Codex: 41.0 (#22), Llama 3-70B: 21.1 (#139)

Agentic & Tool Use benchmarks
BenchmarkGPT-5.2 CodexLlama 3-70B
Terminal-Bench66.5%—
Cybench—5%

Reasoning Not comparable

GPT-5.2 Codex: —, Llama 3-70B: 18.0 (#288)

Reasoning benchmarks
BenchmarkGPT-5.2 CodexLlama 3-70B
Kagi LLM Benchmark—35.1%
LMArena Hard Prompts—1195
DTBench—54.2%
Epoch Capabilities Index—122.93
ForecastBench—57.1
WinoGrande—83.5%

Math Not comparable

GPT-5.2 Codex: —, Llama 3-70B: 12.8 (#305)

Math benchmarks
BenchmarkGPT-5.2 CodexLlama 3-70B
OTIS Mock AIME 2024-2025—4.3%
LMArena Math—1218
MATH Level 5—22.6%

Knowledge Not comparable

GPT-5.2 Codex: —, Llama 3-70B: 20.8 (#277)

Knowledge benchmarks
BenchmarkGPT-5.2 CodexLlama 3-70B
GPQA Diamond—40.6%
LMArena Expert—1149
MMLU—79.3%

Multilingual Not comparable

GPT-5.2 Codex: —, Llama 3-70B: 33.6 (#251)

Multilingual benchmarks
BenchmarkGPT-5.2 CodexLlama 3-70B
LMArena Non-English—1142
LMArena Chinese—1114
LMArena French—1232
LMArena German—1169
LMArena Japanese—1017
LMArena Korean—1017
LMArena Russian—1159
LMArena Spanish—1241

Instruction Following Not comparable

GPT-5.2 Codex: —, Llama 3-70B: 62.5 (#238)

Instruction Following benchmarks
BenchmarkGPT-5.2 CodexLlama 3-70B
LMArena Instruction Following—1194

Long Context Not comparable

GPT-5.2 Codex: —, Llama 3-70B: 35.6 (#240)

Long Context benchmarks
BenchmarkGPT-5.2 CodexLlama 3-70B
LMArena Longer Query—1174

Writing & Preference Not comparable

GPT-5.2 Codex: —, Llama 3-70B: 42.8 (#231)

Writing & Preference benchmarks
BenchmarkGPT-5.2 CodexLlama 3-70B
LMArena Text—1221
LMArena Creative Writing—1210
LMArena Multi-Turn—1223

Frequently asked questions

Is GPT-5.2 Codex better than Llama 3-70B?

GPT-5.2 Codex is the stronger model overall, scoring 42.6 to 28.8 on the Noometry Index.

Is GPT-5.2 Codex or Llama 3-70B better for coding?

GPT-5.2 Codex scores higher on coding benchmarks: 45.5 versus 35.8 in the Noometry coding category.

How many benchmarks do GPT-5.2 Codex and Llama 3-70B share?

0 benchmarks have published results for both models. GPT-5.2 Codex has 5 scored results on Noometry and Llama 3-70B has 31.

Related comparisons

Go deeper