Model comparison

GPT-5.1-Codex vs Magistral Small

GPT-5.1-Codex is the stronger model overall, scoring 38.6 to 30.2 on the Noometry Index. Magistral Small costs 4.6× less per token, which makes it the better buy when GPT-5.1-Codex's lead doesn't matter for your workload.

Last verified . 0 shared benchmarks.

GPT-5.1-Codex OpenAI

38.6

Rank #186 Reported

Magistral Small Mistral AI

30.2

Rank #296 Confirmed

Summary

  • The widest gap is in math, where GPT-5.1-Codex leads 30.3 to 26.2.
  • Magistral Small is cheaper at $0.50 / $1.50 per million input/output tokens, against $1.25 / $10 for GPT-5.1-Codex.
  • GPT-5.1-Codex accepts more context: 400K tokens versus 128K.
  • Magistral Small has downloadable open weights; the other is API-only.

Side by side

GPT-5.1-Codex and Magistral Small specifications
GPT-5.1-CodexMagistral Small
ProviderOpenAIMistral AI
Noometry Index38.630.2
Released2025-11-122025-06-10
WeightsProprietaryOpen
Context window400K128K
Max output128K40K
Input $ / M tokens$1.25$0.50
Output $ / M tokens$10$1.50
Results tracked610

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.1-Codex leads

GPT-5.1-Codex: 41.9 (#116), Magistral Small: 38.4 (#176)

Coding benchmarks
BenchmarkGPT-5.1-CodexMagistral Small
SWE-bench Verified (bash only)66%—
LMArena WebDev1337—
SciCode—35.2%
ALE-Bench1,245—

Agentic & Tool Use Not comparable

GPT-5.1-Codex: 38.0 (#33), Magistral Small: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.1-CodexMagistral Small
Terminal-Bench60.4%—
METR Time Horizons70.8%—

Reasoning Not comparable

GPT-5.1-Codex: —, Magistral Small: 6.8 (#350)

Reasoning benchmarks
BenchmarkGPT-5.1-CodexMagistral Small
ARC-AGI-2—0%
Kagi LLM Benchmark—6.3%
ARC-AGI-1—5%
CritPt—0.3%
Chess Puzzles—3%
DTBench—61.3%
Epoch Capabilities Index—133.19

Math GPT-5.1-Codex leads

GPT-5.1-Codex: 30.3 (#235), Magistral Small: 26.2 (#261)

Math benchmarks
BenchmarkGPT-5.1-CodexMagistral Small
OTIS Mock AIME 2024-2025—30%
ProofBench9%—

Knowledge Not comparable

GPT-5.1-Codex: —, Magistral Small: 30.9 (#223)

Knowledge benchmarks
BenchmarkGPT-5.1-CodexMagistral Small
GPQA Diamond—56.1%

Frequently asked questions

Is GPT-5.1-Codex better than Magistral Small?

GPT-5.1-Codex is the stronger model overall, scoring 38.6 to 30.2 on the Noometry Index. Magistral Small costs 4.6× less per token, which makes it the better buy when GPT-5.1-Codex's lead doesn't matter for your workload.

Which is cheaper, GPT-5.1-Codex or Magistral Small?

Magistral Small is cheaper. It lists at $0.50 per million input tokens and $1.50 per million output tokens; GPT-5.1-Codex lists at $1.25 and $10.

Is GPT-5.1-Codex or Magistral Small better for coding?

GPT-5.1-Codex scores higher on coding benchmarks: 41.9 versus 38.4 in the Noometry coding category.

Which has the bigger context window?

GPT-5.1-Codex does, with 400K tokens against 128K.

How many benchmarks do GPT-5.1-Codex and Magistral Small share?

0 benchmarks have published results for both models. GPT-5.1-Codex has 6 scored results on Noometry and Magistral Small has 10.

Related comparisons

Go deeper