Model comparison

Claude 3 Sonnet vs Hy4 preview

Hy4 preview is the stronger model overall, scoring 44.6 to 28.8 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude 3 Sonnet Anthropic

28.8

Rank #311 Confirmed

Hy4 preview Tencent

44.6

Rank #73 Reported

Summary

  • The widest gap is in math, where Hy4 preview leads 54.5 to 10.0.
  • Hy4 preview has downloadable open weights; the other is API-only.

Side by side

Claude 3 Sonnet and Hy4 preview specifications
Claude 3 SonnetHy4 preview
ProviderAnthropicTencent
Noometry Index28.844.6
Released2024-02-292026-08-28
WeightsProprietaryOpen
Context window—1.05M
Max output—64K
Input $ / M tokens—$0.83
Output $ / M tokens—$2.50
Results tracked303

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hy4 preview leads

Claude 3 Sonnet: 29.2 (#296), Hy4 preview: 51.4 (#36)

Coding benchmarks
BenchmarkClaude 3 SonnetHy4 preview
LMArena WebDev—1633
WeirdML10.2%—
BigCodeBench Instruct42.7%—
LMArena Coding1223—
BigCodeBench Complete53.8%—
HumanEval+64%—
MBPP+69.3%—

Reasoning Hy4 preview leads

Claude 3 Sonnet: 19.7 (#232), Hy4 preview: 30.6 (#75)

Reasoning benchmarks
BenchmarkClaude 3 SonnetHy4 preview
NYT Connections (extended)—68.2%
LMArena Hard Prompts1197—
DTBench53.6%—
Epoch Capabilities Index120.69—
WinoGrande75.1%—

Math Hy4 preview leads

Claude 3 Sonnet: 10.0 (#305), Hy4 preview: 54.5 (#37)

Math benchmarks
BenchmarkClaude 3 SonnetHy4 preview
OTIS Mock AIME 2024-20252.5%—
ProofBench—75%
LMArena Math1213—
MATH Level 518.2%—

Knowledge Not comparable

Claude 3 Sonnet: 21.1 (#271), Hy4 preview: —

Knowledge benchmarks
BenchmarkClaude 3 SonnetHy4 preview
GPQA Diamond40.6%—
LMArena Expert1173—
MMLU75.9%—

Multimodal Not comparable

Claude 3 Sonnet: 24.7 (#120), Hy4 preview: —

Multimodal benchmarks
BenchmarkClaude 3 SonnetHy4 preview
LMArena Vision984—

Multilingual Not comparable

Claude 3 Sonnet: 38.0 (#229), Hy4 preview: —

Multilingual benchmarks
BenchmarkClaude 3 SonnetHy4 preview
LMArena Non-English1205—
LMArena Chinese1188—
LMArena French1228—
LMArena German1204—
LMArena Japanese1131—
LMArena Korean1128—
LMArena Russian1227—
LMArena Spanish1204—

Instruction Following Not comparable

Claude 3 Sonnet: 63.1 (#230), Hy4 preview: —

Instruction Following benchmarks
BenchmarkClaude 3 SonnetHy4 preview
LMArena Instruction Following1200—

Long Context Not comparable

Claude 3 Sonnet: 36.7 (#223), Hy4 preview: —

Long Context benchmarks
BenchmarkClaude 3 SonnetHy4 preview
LMArena Longer Query1211—

Writing & Preference Not comparable

Claude 3 Sonnet: 42.3 (#233), Hy4 preview: —

Writing & Preference benchmarks
BenchmarkClaude 3 SonnetHy4 preview
LMArena Text1218—
LMArena Creative Writing1186—
LMArena Multi-Turn1227—

Frequently asked questions

Is Claude 3 Sonnet better than Hy4 preview?

Hy4 preview is the stronger model overall, scoring 44.6 to 28.8 on the Noometry Index.

Is Claude 3 Sonnet or Hy4 preview better for coding?

Hy4 preview scores higher on coding benchmarks: 51.4 versus 29.2 in the Noometry coding category.

How many benchmarks do Claude 3 Sonnet and Hy4 preview share?

0 benchmarks have published results for both models. Claude 3 Sonnet has 30 scored results on Noometry and Hy4 preview has 3.

Related comparisons

Go deeper