Model comparison

GPT-4o mini vs Hy4 preview

Hy4 preview is the stronger model overall, scoring 45.3 to 25.5 on the Noometry Index. GPT-4o mini costs 4.8× less per token, which makes it the better buy when Hy4 preview's lead doesn't matter for your workload.

Last verified . 0 shared benchmarks.

GPT-4o mini OpenAI

25.5

Rank #343 Confirmed

Hy4 preview Tencent

45.3

Rank #73 Reported

Summary

  • The widest gap is in math, where Hy4 preview leads 55.7 to 10.4.
  • GPT-4o mini is cheaper at $0.15 / $0.60 per million input/output tokens, against $0.83 / $2.50 for Hy4 preview.
  • Hy4 preview accepts more context: 1.05M tokens versus 128K.
  • Hy4 preview has downloadable open weights; the other is API-only.

Side by side

GPT-4o mini and Hy4 preview specifications
GPT-4o miniHy4 preview
ProviderOpenAITencent
Noometry Index25.545.3
Released2024-07-182026-08-28
WeightsProprietaryOpen
Context window128K1.05M
Max output16K64K
Input $ / M tokens$0.15$0.83
Output $ / M tokens$0.60$2.50
Results tracked603

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hy4 preview leads

GPT-4o mini: 22.0 (#335), Hy4 preview: 51.6 (#38)

Coding benchmarks
BenchmarkGPT-4o miniHy4 preview
Aider Polyglot3.6%—
LMArena WebDev—1632
WeirdML11.8%—
BigCodeBench Instruct46.1%—
LiveBench Coding43.1%—
LMArena Coding1290—
BigCodeBench Complete57.4%—
HumanEval+83.5%—
MBPP+72.2%—

Agentic & Tool Use Not comparable

GPT-4o mini: 27.5 (#101), Hy4 preview: —

Agentic & Tool Use benchmarks
BenchmarkGPT-4o miniHy4 preview
BALROG17.4%—

Reasoning Hy4 preview leads

GPT-4o mini: 8.7 (#347), Hy4 preview: 31.9 (#79)

Reasoning benchmarks
BenchmarkGPT-4o miniHy4 preview
ARC-AGI-20%—
SimpleBench10.7%—
Kagi LLM Benchmark28.8%—
NYT Connections (extended)—68.2%
Chess Puzzles0%—
LiveBench Reasoning32.8%—
LMArena Hard Prompts1267—
Mystery Game Puzzles12%—
DTBench54.4%—
LiveBench Data Analysis50%—
LMCA10.4%—
Epoch Capabilities Index126.56—
LiveBench41.3%—
PIQA88.7%—

Math Hy4 preview leads

GPT-4o mini: 10.4 (#314), Hy4 preview: 55.7 (#42)

Math benchmarks
BenchmarkGPT-4o miniHy4 preview
FrontierMath (Tiers 1-3)0.7%—
OTIS Mock AIME 2024-20256.9%—
ProofBench—75%
Omni-MATH28%—
LiveBench Math36.3%—
LMArena Math1267—
MATH Level 552.6%—
GSM8K91.3%—

Knowledge Not comparable

GPT-4o mini: 17.7 (#284), Hy4 preview: —

Knowledge benchmarks
BenchmarkGPT-4o miniHy4 preview
GPQA Diamond37.7%—
SimpleQA Verified8.3%—
MMLU-Pro60.3%—
Confabulations37.2%—
GPQA (HELM)36.8%—
LMArena Expert1235—
BoolQ88.7%—
MMLU81.8%—

Multimodal Not comparable

GPT-4o mini: 25.9 (#122), Hy4 preview: —

Multimodal benchmarks
BenchmarkGPT-4o miniHy4 preview
LMArena Vision1066—
Video-MME64.8%—
GeoBench64%—
VPCT34%—

Multilingual Not comparable

GPT-4o mini: 42.0 (#199), Hy4 preview: —

Multilingual benchmarks
BenchmarkGPT-4o miniHy4 preview
LMArena Non-English1266—
LMArena Chinese1265—
LMArena French1297—
LMArena German1272—
LMArena Japanese1216—
LMArena Korean1195—
LMArena Russian1275—
LMArena Spanish1276—

Instruction Following Not comparable

GPT-4o mini: 61.9 (#239), Hy4 preview: —

Instruction Following benchmarks
BenchmarkGPT-4o miniHy4 preview
LiveBench Instruction Following56.8%—
IFEval78.2%—
LMArena Instruction Following1258—

Long Context Not comparable

GPT-4o mini: 39.1 (#186), Hy4 preview: —

Long Context benchmarks
BenchmarkGPT-4o miniHy4 preview
LMArena Longer Query1289—

Writing & Preference Not comparable

GPT-4o mini: 39.5 (#248), Hy4 preview: —

Writing & Preference benchmarks
BenchmarkGPT-4o miniHy4 preview
LMArena Text1286—
LMArena Creative Writing1268—
Short-Story Creative Writing67.2%—
EQ-Bench Creative Writing873—
WildBench79.1%—
LMArena Multi-Turn1285—
LiveBench Language28.6%—

Frequently asked questions

Is GPT-4o mini better than Hy4 preview?

Hy4 preview is the stronger model overall, scoring 45.3 to 25.5 on the Noometry Index. GPT-4o mini costs 4.8× less per token, which makes it the better buy when Hy4 preview's lead doesn't matter for your workload.

Which is cheaper, GPT-4o mini or Hy4 preview?

GPT-4o mini is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; Hy4 preview lists at $0.83 and $2.50.

Is GPT-4o mini or Hy4 preview better for coding?

Hy4 preview scores higher on coding benchmarks: 51.6 versus 22.0 in the Noometry coding category.

Which has the bigger context window?

Hy4 preview does, with 1.05M tokens against 128K.

How many benchmarks do GPT-4o mini and Hy4 preview share?

0 benchmarks have published results for both models. GPT-4o mini has 60 scored results on Noometry and Hy4 preview has 3.

Related comparisons

Go deeper