Model comparison

Claude 3.7 Sonnet vs Hy4 preview

Hy4 preview is the stronger model overall, scoring 45.3 to 39.5 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude 3.7 Sonnet Anthropic

39.5

Rank #164 Confirmed

Hy4 preview Tencent

45.3

Rank #73 Reported

Summary

  • The widest gap is in math, where Hy4 preview leads 55.7 to 37.5.
  • Hy4 preview has downloadable open weights; the other is API-only.

Side by side

Claude 3.7 Sonnet and Hy4 preview specifications
Claude 3.7 SonnetHy4 preview
ProviderAnthropicTencent
Noometry Index39.545.3
Released2025-02-242026-08-28
WeightsProprietaryOpen
Context window—1.05M
Max output—64K
Input $ / M tokens—$0.83
Output $ / M tokens—$2.50
Results tracked583

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hy4 preview leads

Claude 3.7 Sonnet: 40.6 (#136), Hy4 preview: 51.6 (#38)

Coding benchmarks
BenchmarkClaude 3.7 SonnetHy4 preview
SWE-bench Verified61%—
SWE-bench Verified (bash only)52.8%—
Aider Polyglot64.9%—
LMArena WebDev—1632
GSO3.8%—
LiveBench Coding74.5%—
LMArena Coding1361—
CadEval54%—

Agentic & Tool Use Not comparable

Claude 3.7 Sonnet: 34.1 (#50), Hy4 preview: —

Agentic & Tool Use benchmarks
BenchmarkClaude 3.7 SonnetHy4 preview
TheAgentCompany30.9%—
Cybench20%—
DeepResearch Bench43.6%—
OSWorld35.8%—
METR Time Horizons60%—

Reasoning Hy4 preview leads

Claude 3.7 Sonnet: 18.6 (#277), Hy4 preview: 31.9 (#79)

Reasoning benchmarks
BenchmarkClaude 3.7 SonnetHy4 preview
ARC-AGI-20.9%—
SimpleBench46.4%—
NYT Connections (extended)—68.2%
ARC-AGI-128.6%—
EnigmaEval4.2%—
LiveBench Reasoning87.8%—
LMArena Hard Prompts1333—
LiveBench Data Analysis74%—
Epoch Capabilities Index141.16—
ForecastBench61.8—
LiveBench76.1%—

Math Hy4 preview leads

Claude 3.7 Sonnet: 37.5 (#153), Hy4 preview: 55.7 (#42)

Math benchmarks
BenchmarkClaude 3.7 SonnetHy4 preview
OTIS Mock AIME 2024-202557.8%—
ProofBench—75%
Omni-MATH33%—
LiveBench Math79%—
LMArena Math1337—
MATH Level 591.2%—
FrontierMath (Feb 2025 set)4.1%—

Knowledge Not comparable

Claude 3.7 Sonnet: 39.8 (#130), Hy4 preview: —

Knowledge benchmarks
BenchmarkClaude 3.7 SonnetHy4 preview
GPQA Diamond79.7%—
Humanity's Last Exam8%—
MMLU-Pro78.4%—
Confabulations14.7%—
GPQA (HELM)60.8%—
LMArena Expert1321—

Multimodal Not comparable

Claude 3.7 Sonnet: 33.7 (#95), Hy4 preview: —

Multimodal benchmarks
BenchmarkClaude 3.7 SonnetHy4 preview
LMArena Vision1169—
GeoBench68%—
VPCT39%—
SpatialViz-Bench33.9%—

Multilingual Not comparable

Claude 3.7 Sonnet: 44.1 (#179), Hy4 preview: —

Multilingual benchmarks
BenchmarkClaude 3.7 SonnetHy4 preview
LMArena Non-English1296—
LMArena Chinese1299—
LMArena French1303—
LMArena German1301—
LMArena Japanese1267—
LMArena Korean1249—
LMArena Russian1311—
LMArena Spanish1298—

Instruction Following Not comparable

Claude 3.7 Sonnet: 72.9 (#125), Hy4 preview: —

Instruction Following benchmarks
BenchmarkClaude 3.7 SonnetHy4 preview
LiveBench Instruction Following81.3%—
IFEval83.4%—
LMArena Instruction Following1352—

Long Context Not comparable

Claude 3.7 Sonnet: 50.3 (#10), Hy4 preview: —

Long Context benchmarks
BenchmarkClaude 3.7 SonnetHy4 preview
Fiction.LiveBench83.3%—
LMArena Longer Query1373—

Writing & Preference Not comparable

Claude 3.7 Sonnet: 54.4 (#150), Hy4 preview: —

Writing & Preference benchmarks
BenchmarkClaude 3.7 SonnetHy4 preview
LMArena Text1314—
LMArena Creative Writing1332—
Short-Story Creative Writing81.1%—
EQ-Bench Creative Writing1412—
WildBench81.4%—
LMArena Multi-Turn1339—
LiveBench Language59.9%—

Frequently asked questions

Is Claude 3.7 Sonnet better than Hy4 preview?

Hy4 preview is the stronger model overall, scoring 45.3 to 39.5 on the Noometry Index.

Is Claude 3.7 Sonnet or Hy4 preview better for coding?

Hy4 preview scores higher on coding benchmarks: 51.6 versus 40.6 in the Noometry coding category.

How many benchmarks do Claude 3.7 Sonnet and Hy4 preview share?

0 benchmarks have published results for both models. Claude 3.7 Sonnet has 58 scored results on Noometry and Hy4 preview has 3.

Related comparisons

Go deeper