Model comparison

GPT-5.6 Luna vs Magistral Small

GPT-5.6 Luna is the stronger model overall, scoring 54.6 to 30.2 on the Noometry Index.

Last verified . 10 shared benchmarks.

GPT-5.6 Luna OpenAI

54.6

Rank #30 Confirmed

Magistral Small Mistral AI

30.2

Rank #296 Confirmed

Summary

  • They share 10 benchmarks with published results for both. GPT-5.6 Luna scores higher in 4 categories and Magistral Small in 0 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.6 Luna leads 77.7 to 26.2.
  • The biggest single-benchmark swing is ARC-AGI-1: 88% for GPT-5.6 Luna and 5% for Magistral Small.
  • GPT-5.6 Luna is cheaper at $0.20 / $1.20 per million input/output tokens, against $0.50 / $1.50 for Magistral Small.
  • GPT-5.6 Luna accepts more context: 1.05M tokens versus 128K.
  • Magistral Small has downloadable open weights; the other is API-only.

Side by side

GPT-5.6 Luna and Magistral Small specifications
GPT-5.6 LunaMagistral Small
ProviderOpenAIMistral AI
Noometry Index54.630.2
Released2026-07-092025-06-10
WeightsProprietaryOpen
Context window1.05M128K
Max output128K40K
Input $ / M tokens$0.20$0.50
Output $ / M tokens$1.20$1.50
Results tracked5210

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.6 Luna leads

GPT-5.6 Luna: 54.5 (#28), Magistral Small: 38.4 (#176)

Coding benchmarks
BenchmarkGPT-5.6 LunaMagistral Small
SciCode53.6%35.2%
DeepSWE67.2%—
FrontierCode39.8%—
CursorBench35.9%—
LMArena WebDev1519—
WeirdML60.9%—
LMArena Coding1466—
ALE-Bench1,667—

Agentic & Tool Use Not comparable

GPT-5.6 Luna: 34.4 (#45), Magistral Small: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.6 LunaMagistral Small
APEX-Agents43%—
BALROG45.6%—
GDP.pdf22.7%—
Vending-Bench 24,095—

Reasoning GPT-5.6 Luna leads

GPT-5.6 Luna: 47.6 (#43), Magistral Small: 6.8 (#350)

Reasoning benchmarks
BenchmarkGPT-5.6 LunaMagistral Small
ARC-AGI-259.5%0%
Kagi LLM Benchmark49.1%6.3%
ARC-AGI-188%5%
CritPt20.6%0.3%
Chess Puzzles40%3%
DTBench89.1%61.3%
Epoch Capabilities Index156.39133.19
SimpleBench46.8%—
NYT Connections (extended)69.4%—
LMArena Hard Prompts1451—
Mystery Game Puzzles21%—
LMCA48.5%—
Surface Evolver Bench61.9%—

Math GPT-5.6 Luna leads

GPT-5.6 Luna: 77.7 (#14), Magistral Small: 26.2 (#261)

Math benchmarks
BenchmarkGPT-5.6 LunaMagistral Small
OTIS Mock AIME 2024-202598.3%30%
FrontierMath (Tiers 1-3)82.1%—
FrontierMath Tier 461%—
ProofBench60%—
LMArena Math1458—

Knowledge GPT-5.6 Luna leads

GPT-5.6 Luna: 58.5 (#34), Magistral Small: 30.9 (#223)

Knowledge benchmarks
BenchmarkGPT-5.6 LunaMagistral Small
GPQA Diamond91.6%56.1%
SimpleQA Verified41%—
LMArena Expert1478—

Multimodal Not comparable

GPT-5.6 Luna: 42.7 (#28), Magistral Small: —

Multimodal benchmarks
BenchmarkGPT-5.6 LunaMagistral Small
LMArena Vision1258—
Blueprint-Bench 222.6%—
Furniture Assembly42.5%—
LMArena Document1457—

Multilingual Not comparable

GPT-5.6 Luna: 52.8 (#78), Magistral Small: —

Multilingual benchmarks
BenchmarkGPT-5.6 LunaMagistral Small
LMArena Non-English1417—
LMArena Chinese1470—
LMArena French1456—
LMArena German1454—
LMArena Japanese1411—
LMArena Korean1415—
LMArena Russian1428—
LMArena Spanish1448—

Instruction Following Not comparable

GPT-5.6 Luna: 75.6 (#57), Magistral Small: —

Instruction Following benchmarks
BenchmarkGPT-5.6 LunaMagistral Small
LMArena Instruction Following1437—

Long Context Not comparable

GPT-5.6 Luna: 43.9 (#82), Magistral Small: —

Long Context benchmarks
BenchmarkGPT-5.6 LunaMagistral Small
LMArena Longer Query1436—

Writing & Preference Not comparable

GPT-5.6 Luna: 68.0 (#29), Magistral Small: —

Writing & Preference benchmarks
BenchmarkGPT-5.6 LunaMagistral Small
LMArena Text1431—
LMArena Creative Writing1396—
EQ-Bench Creative Writing1829—
EQ-Bench 41156—
LMArena Multi-Turn1434—

Frequently asked questions

Is GPT-5.6 Luna better than Magistral Small?

GPT-5.6 Luna is the stronger model overall, scoring 54.6 to 30.2 on the Noometry Index.

Which is cheaper, GPT-5.6 Luna or Magistral Small?

GPT-5.6 Luna is cheaper. It lists at $0.20 per million input tokens and $1.20 per million output tokens; Magistral Small lists at $0.50 and $1.50.

Is GPT-5.6 Luna or Magistral Small better for coding?

GPT-5.6 Luna scores higher on coding benchmarks: 54.5 versus 38.4 in the Noometry coding category.

Which has the bigger context window?

GPT-5.6 Luna does, with 1.05M tokens against 128K.

How many benchmarks do GPT-5.6 Luna and Magistral Small share?

10 benchmarks have published results for both models. GPT-5.6 Luna has 52 scored results on Noometry and Magistral Small has 10.

Related comparisons

Go deeper