Model comparison

GPT-4 vs Hy3

Hy3 is the stronger model overall, scoring 44.2 to 29.1 on the Noometry Index.

Last verified . 17 shared benchmarks.

GPT-4 OpenAI

29.1

Rank #316 Confirmed

Hy3 Tencent

44.2

Rank #79 Confirmed

Summary

  • They share 17 benchmarks with published results for both. GPT-4 scores higher in 0 categories and Hy3 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Hy3 leads 40.1 to 10.8.
  • Hy3 is cheaper at $0.0825 / $0.33 per million input/output tokens, against $30 / $60 for GPT-4.
  • Hy3 accepts more context: 262K tokens versus 8K.
  • Hy3 has downloadable open weights; the other is API-only.

Side by side

GPT-4 and Hy3 specifications
GPT-4Hy3
ProviderOpenAITencent
Noometry Index29.144.2
Released2023-03-142026-07-06
WeightsProprietaryOpen
Context window8K262K
Max output8K128K
Input $ / M tokens$30$0.0825
Output $ / M tokens$60$0.33
Results tracked3819

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hy3 leads

GPT-4: 31.6 (#283), Hy3: 46.8 (#63)

Coding benchmarks
BenchmarkGPT-4Hy3
LMArena Coding12541464
LMArena WebDev—1508
WeirdML12.4%—
BigCodeBench Instruct46%—
BigCodeBench Complete57.2%—
HumanEval+79.3%—

Agentic & Tool Use Not comparable

GPT-4: —, Hy3: —

Agentic & Tool Use benchmarks
BenchmarkGPT-4Hy3
METR Time Horizons36.1%—

Reasoning Hy3 leads

GPT-4: 17.8 (#289), Hy3: 26.1 (#136)

Reasoning benchmarks
BenchmarkGPT-4Hy3
LMArena Hard Prompts12411447
NYT Connections (extended)—41.2%
Chess Puzzles4%—
Mystery Game Puzzles12%—
DTBench62.7%—
LMCA17.1%—
BIG-Bench Hard75.1%—
Epoch Capabilities Index125.89—
ForecastBench57.8—
HellaSwag95.3%—
WinoGrande87.5%—

Math Hy3 leads

GPT-4: 10.8 (#309), Hy3: 40.1 (#93)

Math benchmarks
BenchmarkGPT-4Hy3
LMArena Math12691475
OTIS Mock AIME 2024-20251.1%—
MATH Level 523%—
GSM8K92%—

Knowledge Hy3 leads

GPT-4: 18.4 (#282), Hy3: 40.8 (#114)

Knowledge benchmarks
BenchmarkGPT-4Hy3
LMArena Expert12111460
GPQA Diamond35.7%—
MMLU86.4%—
TriviaQA84.8%—

Multilingual Hy3 leads

GPT-4: 40.6 (#215), Hy3: 53.5 (#65)

Multilingual benchmarks
BenchmarkGPT-4Hy3
LMArena Non-English12461426
LMArena Chinese12421493
LMArena French12831461
LMArena German12511439
LMArena Japanese12091392
LMArena Korean11841395
LMArena Russian12511432
LMArena Spanish12611456

Instruction Following Hy3 leads

GPT-4: 65.3 (#222), Hy3: 75.1 (#70)

Instruction Following benchmarks
BenchmarkGPT-4Hy3
LMArena Instruction Following12411426

Long Context Hy3 leads

GPT-4: 37.7 (#212), Hy3: 44.1 (#75)

Long Context benchmarks
BenchmarkGPT-4Hy3
LMArena Longer Query12441442

Writing & Preference Hy3 leads

GPT-4: 34.9 (#268), Hy3: 62.2 (#81)

Writing & Preference benchmarks
BenchmarkGPT-4Hy3
LMArena Text12631439
LMArena Creative Writing12441402
LMArena Multi-Turn12571436
EQ-Bench Creative Writing752—

Frequently asked questions

Is GPT-4 better than Hy3?

Hy3 is the stronger model overall, scoring 44.2 to 29.1 on the Noometry Index.

Which is cheaper, GPT-4 or Hy3?

Hy3 is cheaper. It lists at $0.0825 per million input tokens and $0.33 per million output tokens; GPT-4 lists at $30 and $60.

Is GPT-4 or Hy3 better for coding?

Hy3 scores higher on coding benchmarks: 46.8 versus 31.6 in the Noometry coding category.

Which has the bigger context window?

Hy3 does, with 262K tokens against 8K.

How many benchmarks do GPT-4 and Hy3 share?

17 benchmarks have published results for both models. GPT-4 has 38 scored results on Noometry and Hy3 has 19.

Related comparisons

Go deeper