Model comparison

Claude 2 vs Hunyuan T1 20250711

Hunyuan T1 20250711 is the stronger model overall, scoring 42.5 to 25.0 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude 2 Anthropic

25.0

Rank #346 Reported

Hunyuan T1 20250711 Tencent

42.5

Rank #114 Confirmed

Summary

  • The widest gap is in math, where Hunyuan T1 20250711 leads 38.7 to 9.3.

Side by side

Claude 2 and Hunyuan T1 20250711 specifications
Claude 2Hunyuan T1 20250711
ProviderAnthropicTencent
Noometry Index25.042.5
Released2023-07-11—
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked813

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude 2: —, Hunyuan T1 20250711: 40.9 (#129)

Coding benchmarks
BenchmarkClaude 2Hunyuan T1 20250711
LMArena Coding—1390
HumanEval+61.6%—

Reasoning Hunyuan T1 20250711 leads

Claude 2: 21.7 (#216), Hunyuan T1 20250711: 28.5 (#103)

Reasoning benchmarks
BenchmarkClaude 2Hunyuan T1 20250711
LMArena Hard Prompts—1399
DTBench51.9%—
Epoch Capabilities Index120.13—

Math Hunyuan T1 20250711 leads

Claude 2: 9.3 (#320), Hunyuan T1 20250711: 38.7 (#130)

Math benchmarks
BenchmarkClaude 2Hunyuan T1 20250711
OTIS Mock AIME 2024-20252.5%—
LMArena Math—1414
MATH Level 511.7%—

Knowledge Hunyuan T1 20250711 leads

Claude 2: 16.9 (#287), Hunyuan T1 20250711: 38.8 (#141)

Knowledge benchmarks
BenchmarkClaude 2Hunyuan T1 20250711
GPQA Diamond34.7%—
LMArena Expert—1395
MMLU78.5%—
TriviaQA87.5%—

Multilingual Not comparable

Claude 2: —, Hunyuan T1 20250711: 51.2 (#112)

Multilingual benchmarks
BenchmarkClaude 2Hunyuan T1 20250711
LMArena Non-English—1395
LMArena Chinese—1425
LMArena Korean—1406
LMArena Russian—1385

Instruction Following Not comparable

Claude 2: —, Hunyuan T1 20250711: 72.6 (#138)

Instruction Following benchmarks
BenchmarkClaude 2Hunyuan T1 20250711
LMArena Instruction Following—1374

Long Context Not comparable

Claude 2: —, Hunyuan T1 20250711: 42.2 (#128)

Long Context benchmarks
BenchmarkClaude 2Hunyuan T1 20250711
LMArena Longer Query—1384

Writing & Preference Not comparable

Claude 2: —, Hunyuan T1 20250711: 59.5 (#109)

Writing & Preference benchmarks
BenchmarkClaude 2Hunyuan T1 20250711
LMArena Text—1401
LMArena Creative Writing—1392
LMArena Multi-Turn—1393

Frequently asked questions

Is Claude 2 better than Hunyuan T1 20250711?

Hunyuan T1 20250711 is the stronger model overall, scoring 42.5 to 25.0 on the Noometry Index.

How many benchmarks do Claude 2 and Hunyuan T1 20250711 share?

0 benchmarks have published results for both models. Claude 2 has 8 scored results on Noometry and Hunyuan T1 20250711 has 13.

Related comparisons

Go deeper