Noometry

Model comparison

GPT-5.6 Luna vs Grok-3 mini

GPT-5.6 Luna is the stronger model overall, scoring 54.6 to 41.2 on the Noometry Index.

Last verified . 24 shared benchmarks.

GPT-5.6 Luna OpenAI

54.6

Rank #30 Confirmed

Grok-3 mini xAI

41.2

Rank #141 Confirmed

Summary

  • They share 24 benchmarks with published results for both. GPT-5.6 Luna scores higher in 7 categories and Grok-3 mini in 1 category; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.6 Luna leads 77.7 to 42.1.
  • The biggest single-benchmark swing is ARC-AGI-1: 88% for GPT-5.6 Luna and 16.5% for Grok-3 mini.

Side by side

GPT-5.6 LunaGrok-3 mini
ProviderOpenAIxAI
Noometry Index54.641.2
Released2026-07-092025-04-09
WeightsProprietaryProprietary
Context window1.05M—
Max output128K—
Input $ / M tokens$0.20—
Output $ / M tokens$1.20—
Results tracked5235

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.6 Luna leads

GPT-5.6 Luna: 54.5 (#28), Grok-3 mini: 40.8 (#131)

BenchmarkGPT-5.6 LunaGrok-3 mini
WeirdML60.9%42.6%
LMArena Coding14661379
DeepSWE67.2%—
FrontierCode39.8%—
Aider Polyglot—49.3%
CursorBench35.9%—
LMArena WebDev1519—
SciCode53.6%—
ALE-Bench1,667—

Agentic & Tool Use Not comparable

GPT-5.6 Luna: 34.4 (#45), Grok-3 mini: —

BenchmarkGPT-5.6 LunaGrok-3 mini
APEX-Agents43%—
BALROG45.6%—
GDP.pdf22.7%—
Vending-Bench 24,095—

Reasoning GPT-5.6 Luna leads

GPT-5.6 Luna: 47.6 (#43), Grok-3 mini: 13.6 (#334)

BenchmarkGPT-5.6 LunaGrok-3 mini
ARC-AGI-259.5%0.4%
Kagi LLM Benchmark49.1%61.3%
ARC-AGI-188%16.5%
LMArena Hard Prompts14511375
Epoch Capabilities Index156.39140.35
SimpleBench46.8%—
NYT Connections (extended)69.4%—
CritPt20.6%—
Chess Puzzles40%—
Mystery Game Puzzles21%—
DTBench89.1%—
LMCA48.5%—
Surface Evolver Bench61.9%—

Math GPT-5.6 Luna leads

GPT-5.6 Luna: 77.7 (#14), Grok-3 mini: 42.1 (#85)

BenchmarkGPT-5.6 LunaGrok-3 mini
OTIS Mock AIME 2024-202598.3%77.8%
LMArena Math14581386
FrontierMath (Tiers 1-3)82.1%—
FrontierMath Tier 461%—
ProofBench60%—
Omni-MATH—31.8%
MATH Level 5—90.9%
FrontierMath (Feb 2025 set)—5.9%

Knowledge GPT-5.6 Luna leads

GPT-5.6 Luna: 58.5 (#34), Grok-3 mini: 46.4 (#81)

BenchmarkGPT-5.6 LunaGrok-3 mini
GPQA Diamond91.6%76.3%
LMArena Expert14781395
SimpleQA Verified41%—
MMLU-Pro—79.9%
Confabulations—10.8%
GPQA (HELM)—67.5%

Multimodal Not comparable

GPT-5.6 Luna: 42.7 (#28), Grok-3 mini: —

BenchmarkGPT-5.6 LunaGrok-3 mini
LMArena Vision1258—
Blueprint-Bench 222.6%—
Furniture Assembly42.5%—
LMArena Document1457—

Multilingual GPT-5.6 Luna leads

GPT-5.6 Luna: 52.8 (#78), Grok-3 mini: 48.1 (#145)

BenchmarkGPT-5.6 LunaGrok-3 mini
LMArena Non-English14171352
LMArena Chinese14701387
LMArena French14561357
LMArena German14541349
LMArena Japanese14111342
LMArena Korean14151335
LMArena Russian14281353
LMArena Spanish14481381

Instruction Following Grok-3 mini leads

GPT-5.6 Luna: 75.6 (#57), Grok-3 mini: 78.5 (#9)

BenchmarkGPT-5.6 LunaGrok-3 mini
LMArena Instruction Following14371357
IFEval—95.1%

Long Context GPT-5.6 Luna leads

GPT-5.6 Luna: 43.9 (#82), Grok-3 mini: 41.0 (#147)

BenchmarkGPT-5.6 LunaGrok-3 mini
LMArena Longer Query14361372
Fiction.LiveBench—66.7%

Writing & Preference GPT-5.6 Luna leads

GPT-5.6 Luna: 68.0 (#29), Grok-3 mini: 52.5 (#169)

BenchmarkGPT-5.6 LunaGrok-3 mini
LMArena Text14311370
LMArena Creative Writing13961342
LMArena Multi-Turn14341355
Short-Story Creative Writing—73.5%
EQ-Bench Creative Writing1829—
WildBench—65.1%
EQ-Bench 41156—

Frequently asked questions

Is GPT-5.6 Luna better than Grok-3 mini?

GPT-5.6 Luna is the stronger model overall, scoring 54.6 to 41.2 on the Noometry Index.

Is GPT-5.6 Luna or Grok-3 mini better for coding?

GPT-5.6 Luna scores higher on coding benchmarks: 54.5 versus 40.8 in the Noometry coding category.

How many benchmarks do GPT-5.6 Luna and Grok-3 mini share?

24 benchmarks have published results for both models. GPT-5.6 Luna has 52 scored results on Noometry and Grok-3 mini has 35.

Related comparisons

Go deeper