Model comparison

GPT-5.2 Codex vs Mistral Medium

GPT-5.2 Codex is the stronger model overall, scoring 42.6 to 36.3 on the Noometry Index. Mistral Medium costs 1.6× less per token, which makes it the better buy when GPT-5.2 Codex's lead doesn't matter for your workload.

Last verified . 1 shared benchmarks.

GPT-5.2 Codex OpenAI

42.6

Rank #111 Reported

Mistral Medium Mistral AI

36.3

Rank #218 Confirmed

Summary

  • They share 1 benchmark with published results for both. GPT-5.2 Codex scores higher in 2 categories and Mistral Medium in 0 categories; 2 gaps are clear of the uncertainty.
  • The widest gap is in agentic & tool use, where GPT-5.2 Codex leads 41.0 to 28.3.
  • Mistral Medium is cheaper at $1.50 / $7.50 per million input/output tokens, against $1.75 / $14 for GPT-5.2 Codex.
  • GPT-5.2 Codex accepts more context: 400K tokens versus 262K.
  • Mistral Medium has downloadable open weights; the other is API-only.

Side by side

GPT-5.2 Codex and Mistral Medium specifications
GPT-5.2 CodexMistral Medium
ProviderOpenAIMistral AI
Noometry Index42.636.3
Released2025-12-182023-12-11
WeightsProprietaryOpen
Context window400K262K
Max output128K262K
Input $ / M tokens$1.75$1.50
Output $ / M tokens$14$7.50
Results tracked536

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.2 Codex leads

GPT-5.2 Codex: 45.5 (#71), Mistral Medium: 34.2 (#243)

Coding benchmarks
BenchmarkGPT-5.2 CodexMistral Medium
ALE-Bench1,300763.98
FrontierCode—8%
SWE-bench Verified (bash only)72.8%—
LMArena WebDev1339—
SWE-bench Multilingual66.3%—
SciCode—40.2%
WeirdML—43.7%
LMArena Coding—1434

Agentic & Tool Use GPT-5.2 Codex leads

GPT-5.2 Codex: 41.0 (#22), Mistral Medium: 28.3 (#90)

Agentic & Tool Use benchmarks
BenchmarkGPT-5.2 CodexMistral Medium
Terminal-Bench66.5%—
Berkeley Function Calling Leaderboard—37.7%

Reasoning Not comparable

GPT-5.2 Codex: —, Mistral Medium: 24.0 (#167)

Reasoning benchmarks
BenchmarkGPT-5.2 CodexMistral Medium
Kagi LLM Benchmark—50%
CritPt—0%
LMArena Hard Prompts—1426
DTBench—75.5%
LMCA—26.1%
Surface Evolver Bench—26.9%

Math Not comparable

GPT-5.2 Codex: —, Mistral Medium: 28.1 (#245)

Math benchmarks
BenchmarkGPT-5.2 CodexMistral Medium
OTIS Mock AIME 2024-2025—32.2%
ProofBench—9%
LMArena Math—1408
MATH Level 5—81.6%
FrontierMath (Feb 2025 set)—0.3%

Knowledge Not comparable

GPT-5.2 Codex: —, Mistral Medium: 25.0 (#265)

Knowledge benchmarks
BenchmarkGPT-5.2 CodexMistral Medium
GPQA Diamond—59.5%
Humanity's Last Exam—4.5%
Vectara Hallucination Rate—22.7%
LMArena Expert—1408

Multimodal Not comparable

GPT-5.2 Codex: —, Mistral Medium: 35.3 (#88)

Multimodal benchmarks
BenchmarkGPT-5.2 CodexMistral Medium
LMArena Vision—1172

Multilingual Not comparable

GPT-5.2 Codex: —, Mistral Medium: 52.1 (#91)

Multilingual benchmarks
BenchmarkGPT-5.2 CodexMistral Medium
LMArena Non-English—1408
LMArena Chinese—1447
LMArena French—1459
LMArena German—1432
LMArena Japanese—1378
LMArena Korean—1380
LMArena Russian—1411
LMArena Spanish—1433

Instruction Following Not comparable

GPT-5.2 Codex: —, Mistral Medium: 73.7 (#116)

Instruction Following benchmarks
BenchmarkGPT-5.2 CodexMistral Medium
LMArena Instruction Following—1398

Long Context Not comparable

GPT-5.2 Codex: —, Mistral Medium: 42.9 (#114)

Long Context benchmarks
BenchmarkGPT-5.2 CodexMistral Medium
LMArena Longer Query—1406

Writing & Preference Not comparable

GPT-5.2 Codex: —, Mistral Medium: 60.0 (#103)

Writing & Preference benchmarks
BenchmarkGPT-5.2 CodexMistral Medium
LMArena Text—1424
LMArena Creative Writing—1391
Short-Story Creative Writing—77.3%
LMArena Multi-Turn—1418

Frequently asked questions

Is GPT-5.2 Codex better than Mistral Medium?

GPT-5.2 Codex is the stronger model overall, scoring 42.6 to 36.3 on the Noometry Index. Mistral Medium costs 1.6× less per token, which makes it the better buy when GPT-5.2 Codex's lead doesn't matter for your workload.

Which is cheaper, GPT-5.2 Codex or Mistral Medium?

Mistral Medium is cheaper. It lists at $1.50 per million input tokens and $7.50 per million output tokens; GPT-5.2 Codex lists at $1.75 and $14.

Is GPT-5.2 Codex or Mistral Medium better for coding?

GPT-5.2 Codex scores higher on coding benchmarks: 45.5 versus 34.2 in the Noometry coding category.

Which has the bigger context window?

GPT-5.2 Codex does, with 400K tokens against 262K.

How many benchmarks do GPT-5.2 Codex and Mistral Medium share?

1 benchmark has published results for both models. GPT-5.2 Codex has 5 scored results on Noometry and Mistral Medium has 36.

Related comparisons

Go deeper