Model comparison

Claude 2.1 vs GPT-5.6 Luna

GPT-5.6 Luna is the stronger model overall, scoring 54.7 to 24.9 on the Noometry Index.

Last verified . 5 shared benchmarks.

Claude 2.1 Anthropic

24.9

Rank #340 Reported

GPT-5.6 Luna OpenAI

54.7

Rank #24 Confirmed

Summary

  • They share 5 benchmarks with published results for both. Claude 2.1 scores higher in 0 categories and GPT-5.6 Luna in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.6 Luna leads 77.5 to 9.6.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 1.9% for Claude 2.1 and 98.3% for GPT-5.6 Luna.

Side by side

Claude 2.1 and GPT-5.6 Luna specifications
Claude 2.1GPT-5.6 Luna
ProviderAnthropicOpenAI
Noometry Index24.954.7
Released2023-11-212026-07-09
WeightsProprietaryProprietary
Context window—1.05M
Max output—128K
Input $ / M tokens—$0.20
Output $ / M tokens—$1.20
Results tracked751

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.6 Luna leads

Claude 2.1: 25.8 (#322), GPT-5.6 Luna: 53.9 (#25)

Coding benchmarks
BenchmarkClaude 2.1GPT-5.6 Luna
WeirdML7.1%60.9%
DeepSWE—67.2%
FrontierCode—39.8%
CursorBench—35.9%
LMArena WebDev—1517
SciCode—53.6%
LMArena Coding—1466
ALE-Bench—1,667

Agentic & Tool Use Not comparable

Claude 2.1: —, GPT-5.6 Luna: 35.3 (#37)

Agentic & Tool Use benchmarks
BenchmarkClaude 2.1GPT-5.6 Luna
BALROG—45.6%
GDP.pdf—22.7%
Vending-Bench 2—4,095

Reasoning GPT-5.6 Luna leads

Claude 2.1: 20.6 (#216), GPT-5.6 Luna: 47.5 (#38)

Reasoning benchmarks
BenchmarkClaude 2.1GPT-5.6 Luna
DTBench51%89.1%
Epoch Capabilities Index119.22156.32
ARC-AGI-2—59.5%
SimpleBench—46.8%
Kagi LLM Benchmark—49.1%
NYT Connections (extended)—69.4%
ARC-AGI-1—88%
CritPt—20.6%
Chess Puzzles—40%
LMArena Hard Prompts—1452
Mystery Game Puzzles—21%
LMCA—48.5%
Surface Evolver Bench—61.9%
ForecastBench54.2—

Math GPT-5.6 Luna leads

Claude 2.1: 9.6 (#309), GPT-5.6 Luna: 77.5 (#12)

Math benchmarks
BenchmarkClaude 2.1GPT-5.6 Luna
OTIS Mock AIME 2024-20251.9%98.3%
FrontierMath (Tiers 1-3)—82.1%
FrontierMath Tier 4—61%
ProofBench—60%
LMArena Math—1455

Knowledge GPT-5.6 Luna leads

Claude 2.1: 15.5 (#287), GPT-5.6 Luna: 58.6 (#31)

Knowledge benchmarks
BenchmarkClaude 2.1GPT-5.6 Luna
GPQA Diamond33%91.6%
SimpleQA Verified—41%
LMArena Expert—1479
MMLU73.5%—

Multimodal Not comparable

Claude 2.1: —, GPT-5.6 Luna: 43.0 (#22)

Multimodal benchmarks
BenchmarkClaude 2.1GPT-5.6 Luna
LMArena Vision—1259
Blueprint-Bench 2—22.6%
Furniture Assembly—42.5%
LMArena Document—1457

Multilingual Not comparable

Claude 2.1: —, GPT-5.6 Luna: 53.0 (#73)

Multilingual benchmarks
BenchmarkClaude 2.1GPT-5.6 Luna
LMArena Non-English—1418
LMArena Chinese—1469
LMArena French—1457
LMArena German—1459
LMArena Japanese—1416
LMArena Korean—1414
LMArena Russian—1428
LMArena Spanish—1445

Instruction Following Not comparable

Claude 2.1: —, GPT-5.6 Luna: 76.0 (#48)

Instruction Following benchmarks
BenchmarkClaude 2.1GPT-5.6 Luna
LMArena Instruction Following—1440

Long Context Not comparable

Claude 2.1: —, GPT-5.6 Luna: 43.9 (#78)

Long Context benchmarks
BenchmarkClaude 2.1GPT-5.6 Luna
LMArena Longer Query—1437

Writing & Preference Not comparable

Claude 2.1: —, GPT-5.6 Luna: 68.3 (#27)

Writing & Preference benchmarks
BenchmarkClaude 2.1GPT-5.6 Luna
LMArena Text—1432
LMArena Creative Writing—1397
EQ-Bench Creative Writing—1829
EQ-Bench 4—1156
LMArena Multi-Turn—1433

Frequently asked questions

Is Claude 2.1 better than GPT-5.6 Luna?

GPT-5.6 Luna is the stronger model overall, scoring 54.7 to 24.9 on the Noometry Index.

Is Claude 2.1 or GPT-5.6 Luna better for coding?

GPT-5.6 Luna scores higher on coding benchmarks: 53.9 versus 25.8 in the Noometry coding category.

How many benchmarks do Claude 2.1 and GPT-5.6 Luna share?

5 benchmarks have published results for both models. Claude 2.1 has 7 scored results on Noometry and GPT-5.6 Luna has 51.

Related comparisons

Go deeper