Noometry

Model comparison

Claude 2 vs GPT-4.5

GPT-4.5 is the stronger model overall, scoring 37.2 to 25.0 on the Noometry Index.

Last verified . 4 shared benchmarks.

Claude 2 Anthropic

25.0

Rank #346 Reported

GPT-4.5 OpenAI

37.2

Rank #208 Confirmed

Summary

  • They share 4 benchmarks with published results for both. Claude 2 scores higher in 1 category and GPT-4.5 in 2 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-4.5 leads 32.6 to 9.3.
  • The biggest single-benchmark swing is MATH Level 5: 11.7% for Claude 2 and 78.6% for GPT-4.5.

Side by side

Claude 2GPT-4.5
ProviderAnthropicOpenAI
Noometry Index25.037.2
Released2023-07-112025-02-27
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked842

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude 2: —, GPT-4.5: 42.2 (#109)

BenchmarkClaude 2GPT-4.5
Aider Polyglot—44.9%
WeirdML—39.4%
LiveBench Coding—75.2%
LMArena Coding—1396
HumanEval+61.6%—

Agentic & Tool Use Not comparable

Claude 2: —, GPT-4.5: 27.9 (#97)

BenchmarkClaude 2GPT-4.5
Cybench—17.5%

Reasoning Claude 2 leads

Claude 2: 21.7 (#216), GPT-4.5: 13.9 (#330)

BenchmarkClaude 2GPT-4.5
Epoch Capabilities Index120.13136.74
ARC-AGI-2—0.8%
SimpleBench—34.5%
ARC-AGI-1—10.3%
EnigmaEval—3.2%
LiveBench Reasoning—71.1%
LMArena Hard Prompts—1403
DTBench51.9%—
LiveBench Data Analysis—64.3%
ForecastBench—61.7
LiveBench—69%

Math GPT-4.5 leads

Claude 2: 9.3 (#320), GPT-4.5: 32.6 (#211)

BenchmarkClaude 2GPT-4.5
OTIS Mock AIME 2024-20252.5%37.8%
MATH Level 511.7%78.6%
LiveBench Math—69.3%
LMArena Math—1412

Knowledge GPT-4.5 leads

Claude 2: 16.9 (#287), GPT-4.5: 32.5 (#211)

BenchmarkClaude 2GPT-4.5
GPQA Diamond34.7%68.7%
Humanity's Last Exam—5.4%
Confabulations—13.6%
LMArena Expert—1394
MMLU78.5%—
TriviaQA87.5%—

Multimodal Not comparable

Claude 2: —, GPT-4.5: 37.6 (#71)

BenchmarkClaude 2GPT-4.5
LMArena Vision—1195
VPCT—45%

Multilingual Not comparable

Claude 2: —, GPT-4.5: 52.5 (#83)

BenchmarkClaude 2GPT-4.5
LMArena Non-English—1413
LMArena Chinese—1421
LMArena French—1418
LMArena German—1457
LMArena Japanese—1416
LMArena Korean—1392
LMArena Russian—1419

Instruction Following Not comparable

Claude 2: —, GPT-4.5: 72.6 (#134)

BenchmarkClaude 2GPT-4.5
LiveBench Instruction Following—72.3%
LMArena Instruction Following—1404

Long Context Not comparable

Claude 2: —, GPT-4.5: 40.4 (#155)

BenchmarkClaude 2GPT-4.5
Fiction.LiveBench—63.9%
LMArena Longer Query—1406

Writing & Preference Not comparable

Claude 2: —, GPT-4.5: 56.9 (#134)

BenchmarkClaude 2GPT-4.5
LMArena Text—1417
LMArena Creative Writing—1394
Short-Story Creative Writing—75.6%
EQ-Bench Creative Writing—1258
LMArena Multi-Turn—1444
LiveBench Language—61.5%

Frequently asked questions

Is Claude 2 better than GPT-4.5?

GPT-4.5 is the stronger model overall, scoring 37.2 to 25.0 on the Noometry Index.

How many benchmarks do Claude 2 and GPT-4.5 share?

4 benchmarks have published results for both models. Claude 2 has 8 scored results on Noometry and GPT-4.5 has 42.

Related comparisons

Go deeper