Model comparison

Claude 2 vs GPT-5.6 Luna

GPT-5.6 Luna is the stronger model overall, scoring 54.7 to 24.7 on the Noometry Index.

Last verified . 4 shared benchmarks.

Claude 2 Anthropic

24.7

Rank #342 Reported

GPT-5.6 Luna OpenAI

54.7

Rank #24 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Claude 2 scores higher in 0 categories and GPT-5.6 Luna in 3 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.6 Luna leads 77.5 to 8.7.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 2.5% for Claude 2 and 98.3% for GPT-5.6 Luna.

Side by side

Claude 2 and GPT-5.6 Luna specifications
Claude 2GPT-5.6 Luna
ProviderAnthropicOpenAI
Noometry Index24.754.7
Released2023-07-112026-07-09
WeightsProprietaryProprietary
Context window—1.05M
Max output—128K
Input $ / M tokens—$0.20
Output $ / M tokens—$1.20
Results tracked851

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude 2: —, GPT-5.6 Luna: 53.9 (#25)

Coding benchmarks
BenchmarkClaude 2GPT-5.6 Luna
DeepSWE—67.2%
FrontierCode—39.8%
CursorBench—35.9%
LMArena WebDev—1517
SciCode—53.6%
WeirdML—60.9%
LMArena Coding—1466
ALE-Bench—1,667
HumanEval+61.6%—

Agentic & Tool Use Not comparable

Claude 2: —, GPT-5.6 Luna: 35.3 (#37)

Agentic & Tool Use benchmarks
BenchmarkClaude 2GPT-5.6 Luna
BALROG—45.6%
GDP.pdf—22.7%
Vending-Bench 2—4,095

Reasoning GPT-5.6 Luna leads

Claude 2: 20.8 (#213), GPT-5.6 Luna: 47.5 (#38)

Reasoning benchmarks
BenchmarkClaude 2GPT-5.6 Luna
DTBench51.9%89.1%
Epoch Capabilities Index120.08156.32
ARC-AGI-2—59.5%
SimpleBench—46.8%
Kagi LLM Benchmark—49.1%
NYT Connections (extended)—69.4%
ARC-AGI-1—88%
CritPt—20.6%
Chess Puzzles—40%
LMArena Hard Prompts—1452
Mystery Game Puzzles—21%
LMCA—48.5%
Surface Evolver Bench—61.9%

Math GPT-5.6 Luna leads

Claude 2: 8.7 (#314), GPT-5.6 Luna: 77.5 (#12)

Math benchmarks
BenchmarkClaude 2GPT-5.6 Luna
OTIS Mock AIME 2024-20252.5%98.3%
FrontierMath (Tiers 1-3)—82.1%
FrontierMath Tier 4—61%
ProofBench—60%
LMArena Math—1455
MATH Level 511.7%—

Knowledge GPT-5.6 Luna leads

Claude 2: 17.0 (#282), GPT-5.6 Luna: 58.6 (#31)

Knowledge benchmarks
BenchmarkClaude 2GPT-5.6 Luna
GPQA Diamond34.7%91.6%
SimpleQA Verified—41%
LMArena Expert—1479
MMLU78.5%—
TriviaQA87.5%—

Multimodal Not comparable

Claude 2: —, GPT-5.6 Luna: 43.0 (#22)

Multimodal benchmarks
BenchmarkClaude 2GPT-5.6 Luna
LMArena Vision—1259
Blueprint-Bench 2—22.6%
Furniture Assembly—42.5%
LMArena Document—1457

Multilingual Not comparable

Claude 2: —, GPT-5.6 Luna: 53.0 (#73)

Multilingual benchmarks
BenchmarkClaude 2GPT-5.6 Luna
LMArena Non-English—1418
LMArena Chinese—1469
LMArena French—1457
LMArena German—1459
LMArena Japanese—1416
LMArena Korean—1414
LMArena Russian—1428
LMArena Spanish—1445

Instruction Following Not comparable

Claude 2: —, GPT-5.6 Luna: 76.0 (#48)

Instruction Following benchmarks
BenchmarkClaude 2GPT-5.6 Luna
LMArena Instruction Following—1440

Long Context Not comparable

Claude 2: —, GPT-5.6 Luna: 43.9 (#78)

Long Context benchmarks
BenchmarkClaude 2GPT-5.6 Luna
LMArena Longer Query—1437

Writing & Preference Not comparable

Claude 2: —, GPT-5.6 Luna: 68.3 (#27)

Writing & Preference benchmarks
BenchmarkClaude 2GPT-5.6 Luna
LMArena Text—1432
LMArena Creative Writing—1397
EQ-Bench Creative Writing—1829
EQ-Bench 4—1156
LMArena Multi-Turn—1433

Frequently asked questions

Is Claude 2 better than GPT-5.6 Luna?

GPT-5.6 Luna is the stronger model overall, scoring 54.7 to 24.7 on the Noometry Index.

How many benchmarks do Claude 2 and GPT-5.6 Luna share?

4 benchmarks have published results for both models. Claude 2 has 8 scored results on Noometry and GPT-5.6 Luna has 51.

Related comparisons

Go deeper