Model comparison

Claude 2.1 vs GPT-6 Luna

GPT-6 Luna is the stronger model overall, scoring 45.1 to 24.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude 2.1 Anthropic

24.9

Rank #340 Reported

GPT-6 Luna OpenAI

45.1

Rank #65 Confirmed

Summary

  • The widest gap is in coding, where GPT-6 Luna leads 54.7 to 25.8.

Side by side

Claude 2.1 and GPT-6 Luna specifications
Claude 2.1GPT-6 Luna
ProviderAnthropicOpenAI
Noometry Index24.945.1
Released2023-11-212026-09-22
WeightsProprietaryProprietary
Context window—1.05M
Max output—128K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.50
Results tracked718

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-6 Luna leads

Claude 2.1: 25.8 (#322), GPT-6 Luna: 54.7 (#24)

Coding benchmarks
BenchmarkClaude 2.1GPT-6 Luna
DeepSWE—66.6%
FrontierCode—42.4%
LMArena WebDev—1583
WeirdML7.1%—
LMArena Coding—1448

Reasoning GPT-6 Luna leads

Claude 2.1: 20.6 (#216), GPT-6 Luna: 31.7 (#68)

Reasoning benchmarks
BenchmarkClaude 2.1GPT-6 Luna
NYT Connections (extended)—68.7%
LMArena Hard Prompts—1415
DTBench51%—
Epoch Capabilities Index119.22—
ForecastBench54.2—

Math GPT-6 Luna leads

Claude 2.1: 9.6 (#309), GPT-6 Luna: 35.6 (#140)

Math benchmarks
BenchmarkClaude 2.1GPT-6 Luna
OTIS Mock AIME 2024-20251.9%—
LMArena Math—1396

Knowledge GPT-6 Luna leads

Claude 2.1: 15.5 (#287), GPT-6 Luna: 40.1 (#110)

Knowledge benchmarks
BenchmarkClaude 2.1GPT-6 Luna
GPQA Diamond33%—
LMArena Expert—1458
MMLU73.5%—

Multimodal Not comparable

Claude 2.1: —, GPT-6 Luna: 42.0 (#27)

Multimodal benchmarks
BenchmarkClaude 2.1GPT-6 Luna
Furniture Assembly—44.2%

Multilingual Not comparable

Claude 2.1: —, GPT-6 Luna: 51.0 (#111)

Multilingual benchmarks
BenchmarkClaude 2.1GPT-6 Luna
LMArena Non-English—1390
LMArena Chinese—1425
LMArena Russian—1392
LMArena Spanish—1416

Instruction Following Not comparable

Claude 2.1: —, GPT-6 Luna: 74.7 (#85)

Instruction Following benchmarks
BenchmarkClaude 2.1GPT-6 Luna
LMArena Instruction Following—1414

Long Context Not comparable

Claude 2.1: —, GPT-6 Luna: 43.3 (#95)

Long Context benchmarks
BenchmarkClaude 2.1GPT-6 Luna
LMArena Longer Query—1417

Writing & Preference Not comparable

Claude 2.1: —, GPT-6 Luna: 58.4 (#115)

Writing & Preference benchmarks
BenchmarkClaude 2.1GPT-6 Luna
LMArena Text—1392
LMArena Creative Writing—1357
LMArena Multi-Turn—1400

Frequently asked questions

Is Claude 2.1 better than GPT-6 Luna?

GPT-6 Luna is the stronger model overall, scoring 45.1 to 24.9 on the Noometry Index.

Is Claude 2.1 or GPT-6 Luna better for coding?

GPT-6 Luna scores higher on coding benchmarks: 54.7 versus 25.8 in the Noometry coding category.

How many benchmarks do Claude 2.1 and GPT-6 Luna share?

0 benchmarks have published results for both models. Claude 2.1 has 7 scored results on Noometry and GPT-6 Luna has 18.

Related comparisons

Go deeper