Model comparison

Claude 3 Sonnet vs Hunyuan T1 20250711

Hunyuan T1 20250711 is the stronger model overall, scoring 41.8 to 28.8 on the Noometry Index.

Last verified . 13 shared benchmarks.

Claude 3 Sonnet Anthropic

28.8

Rank #311 Confirmed

Hunyuan T1 20250711 Tencent

41.8

Rank #114 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Claude 3 Sonnet scores higher in 0 categories and Hunyuan T1 20250711 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Hunyuan T1 20250711 leads 36.0 to 10.0.

Side by side

Claude 3 Sonnet and Hunyuan T1 20250711 specifications
Claude 3 SonnetHunyuan T1 20250711
ProviderAnthropicTencent
Noometry Index28.841.8
Released2024-02-29—
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked3013

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hunyuan T1 20250711 leads

Claude 3 Sonnet: 29.2 (#296), Hunyuan T1 20250711: 40.2 (#129)

Coding benchmarks
BenchmarkClaude 3 SonnetHunyuan T1 20250711
LMArena Coding12231389
WeirdML10.2%—
BigCodeBench Instruct42.7%—
BigCodeBench Complete53.8%—
HumanEval+64%—
MBPP+69.3%—

Reasoning Hunyuan T1 20250711 leads

Claude 3 Sonnet: 19.7 (#232), Hunyuan T1 20250711: 27.3 (#106)

Reasoning benchmarks
BenchmarkClaude 3 SonnetHunyuan T1 20250711
LMArena Hard Prompts11971399
DTBench53.6%—
Epoch Capabilities Index120.69—
WinoGrande75.1%—

Math Hunyuan T1 20250711 leads

Claude 3 Sonnet: 10.0 (#305), Hunyuan T1 20250711: 36.0 (#132)

Math benchmarks
BenchmarkClaude 3 SonnetHunyuan T1 20250711
LMArena Math12131414
OTIS Mock AIME 2024-20252.5%—
MATH Level 518.2%—

Knowledge Hunyuan T1 20250711 leads

Claude 3 Sonnet: 21.1 (#271), Hunyuan T1 20250711: 38.1 (#139)

Knowledge benchmarks
BenchmarkClaude 3 SonnetHunyuan T1 20250711
LMArena Expert11731395
GPQA Diamond40.6%—
MMLU75.9%—

Multimodal Not comparable

Claude 3 Sonnet: 24.7 (#120), Hunyuan T1 20250711: —

Multimodal benchmarks
BenchmarkClaude 3 SonnetHunyuan T1 20250711
LMArena Vision984—

Multilingual Hunyuan T1 20250711 leads

Claude 3 Sonnet: 38.0 (#229), Hunyuan T1 20250711: 51.4 (#107)

Multilingual benchmarks
BenchmarkClaude 3 SonnetHunyuan T1 20250711
LMArena Non-English12051395
LMArena Chinese11881424
LMArena Korean11281403
LMArena Russian12271384
LMArena French1228—
LMArena German1204—
LMArena Japanese1131—
LMArena Spanish1204—

Instruction Following Hunyuan T1 20250711 leads

Claude 3 Sonnet: 63.1 (#230), Hunyuan T1 20250711: 72.8 (#130)

Instruction Following benchmarks
BenchmarkClaude 3 SonnetHunyuan T1 20250711
LMArena Instruction Following12001375

Long Context Hunyuan T1 20250711 leads

Claude 3 Sonnet: 36.7 (#223), Hunyuan T1 20250711: 42.2 (#123)

Long Context benchmarks
BenchmarkClaude 3 SonnetHunyuan T1 20250711
LMArena Longer Query12111384

Writing & Preference Hunyuan T1 20250711 leads

Claude 3 Sonnet: 42.3 (#233), Hunyuan T1 20250711: 59.7 (#105)

Writing & Preference benchmarks
BenchmarkClaude 3 SonnetHunyuan T1 20250711
LMArena Text12181401
LMArena Creative Writing11861391
LMArena Multi-Turn12271393

Frequently asked questions

Is Claude 3 Sonnet better than Hunyuan T1 20250711?

Hunyuan T1 20250711 is the stronger model overall, scoring 41.8 to 28.8 on the Noometry Index.

Is Claude 3 Sonnet or Hunyuan T1 20250711 better for coding?

Hunyuan T1 20250711 scores higher on coding benchmarks: 40.2 versus 29.2 in the Noometry coding category.

How many benchmarks do Claude 3 Sonnet and Hunyuan T1 20250711 share?

13 benchmarks have published results for both models. Claude 3 Sonnet has 30 scored results on Noometry and Hunyuan T1 20250711 has 13.

Related comparisons

Go deeper