Model comparison

Hy4 preview vs o1-mini

Hy4 preview is the stronger model overall, scoring 45.3 to 34.0 on the Noometry Index.

Last verified . 0 shared benchmarks.

Hy4 preview Tencent

45.3

Rank #73 Reported

o1-mini OpenAI

34.0

Rank #235 Confirmed

Summary

  • The widest gap is in reasoning, where Hy4 preview leads 31.9 to 8.8.
  • Hy4 preview has downloadable open weights; the other is API-only.

Side by side

Hy4 preview and o1-mini specifications
Hy4 previewo1-mini
ProviderTencentOpenAI
Noometry Index45.334.0
Released2026-08-282024-09-12
WeightsOpenProprietary
Context window1.05M—
Max output64K—
Input $ / M tokens$0.83—
Output $ / M tokens$2.50—
Results tracked339

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hy4 preview leads

Hy4 preview: 51.6 (#38), o1-mini: 35.5 (#224)

Coding benchmarks
BenchmarkHy4 previewo1-mini
Aider Polyglot—32.9%
LMArena WebDev1632—
WeirdML—36.3%
LiveBench Coding—48%
LMArena Coding—1362
HumanEval+—89%
MBPP+—78.8%

Agentic & Tool Use Not comparable

Hy4 preview: —, o1-mini: 24.6 (#118)

Agentic & Tool Use benchmarks
BenchmarkHy4 previewo1-mini
Cybench—10%

Reasoning Hy4 preview leads

Hy4 preview: 31.9 (#79), o1-mini: 8.8 (#346)

Reasoning benchmarks
BenchmarkHy4 previewo1-mini
ARC-AGI-2—0.8%
SimpleBench—18.1%
NYT Connections (extended)68.2%—
ARC-AGI-1—14%
LiveBench Reasoning—72.3%
LMArena Hard Prompts—1333
LiveBench Data Analysis—57.9%
Epoch Capabilities Index—135.82
LiveBench—57.8%

Math Hy4 preview leads

Hy4 preview: 55.7 (#42), o1-mini: 35.4 (#186)

Math benchmarks
BenchmarkHy4 previewo1-mini
OTIS Mock AIME 2024-2025—46.9%
ProofBench75%—
LiveBench Math—62%
LMArena Math—1358
MATH Level 5—89.2%
FrontierMath (Feb 2025 set)—1.7%

Knowledge Not comparable

Hy4 preview: —, o1-mini: 34.9 (#192)

Knowledge benchmarks
BenchmarkHy4 previewo1-mini
GPQA Diamond—62.4%
Confabulations—18.6%
LMArena Expert—1316

Multilingual Not comparable

Hy4 preview: —, o1-mini: 43.6 (#182)

Multilingual benchmarks
BenchmarkHy4 previewo1-mini
LMArena Non-English—1289
LMArena Chinese—1314
LMArena French—1293
LMArena German—1278
LMArena Japanese—1245
LMArena Korean—1223
LMArena Russian—1283
LMArena Spanish—1303

Instruction Following Not comparable

Hy4 preview: —, o1-mini: 66.7 (#206)

Instruction Following benchmarks
BenchmarkHy4 previewo1-mini
LiveBench Instruction Following—65.4%
LMArena Instruction Following—1304

Long Context Not comparable

Hy4 preview: —, o1-mini: 40.1 (#161)

Long Context benchmarks
BenchmarkHy4 previewo1-mini
LMArena Longer Query—1320

Writing & Preference Not comparable

Hy4 preview: —, o1-mini: 48.4 (#202)

Writing & Preference benchmarks
BenchmarkHy4 previewo1-mini
LMArena Text—1317
LMArena Creative Writing—1244
Short-Story Creative Writing—64.9%
LMArena Multi-Turn—1314
LiveBench Language—40.9%

Frequently asked questions

Is Hy4 preview better than o1-mini?

Hy4 preview is the stronger model overall, scoring 45.3 to 34.0 on the Noometry Index.

Is Hy4 preview or o1-mini better for coding?

Hy4 preview scores higher on coding benchmarks: 51.6 versus 35.5 in the Noometry coding category.

How many benchmarks do Hy4 preview and o1-mini share?

0 benchmarks have published results for both models. Hy4 preview has 3 scored results on Noometry and o1-mini has 39.

Related comparisons

Go deeper