Model comparison

Grok 2 Mini 2024 08 13 vs Hy4 preview

Hy4 preview is the stronger model overall, scoring 45.3 to 37.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

Grok 2 Mini 2024 08 13 xAI

37.7

Rank #198 Confirmed

Hy4 preview Tencent

45.3

Rank #73 Reported

Summary

  • The widest gap is in math, where Hy4 preview leads 55.7 to 35.4.
  • Hy4 preview has downloadable open weights; the other is API-only.

Side by side

Grok 2 Mini 2024 08 13 and Hy4 preview specifications
Grok 2 Mini 2024 08 13Hy4 preview
ProviderxAITencent
Noometry Index37.745.3
Released2024-08-132026-08-28
WeightsProprietaryOpen
Context window—1.05M
Max output—64K
Input $ / M tokens—$0.75
Output $ / M tokens—$2.25
Results tracked173

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hy4 preview leads

Grok 2 Mini 2024 08 13: 37.0 (#199), Hy4 preview: 51.6 (#38)

Coding benchmarks
BenchmarkGrok 2 Mini 2024 08 13Hy4 preview
LMArena WebDev—1632
LMArena Coding1269—

Reasoning Hy4 preview leads

Grok 2 Mini 2024 08 13: 24.8 (#159), Hy4 preview: 31.9 (#79)

Reasoning benchmarks
BenchmarkGrok 2 Mini 2024 08 13Hy4 preview
NYT Connections (extended)—68.2%
LMArena Hard Prompts1255—

Math Hy4 preview leads

Grok 2 Mini 2024 08 13: 35.4 (#185), Hy4 preview: 55.7 (#42)

Math benchmarks
BenchmarkGrok 2 Mini 2024 08 13Hy4 preview
ProofBench—75%
LMArena Math1265—

Knowledge Not comparable

Grok 2 Mini 2024 08 13: 33.9 (#200), Hy4 preview: —

Knowledge benchmarks
BenchmarkGrok 2 Mini 2024 08 13Hy4 preview
LMArena Expert1238—

Multilingual Not comparable

Grok 2 Mini 2024 08 13: 41.4 (#208), Hy4 preview: —

Multilingual benchmarks
BenchmarkGrok 2 Mini 2024 08 13Hy4 preview
LMArena Non-English1257—
LMArena Chinese1262—
LMArena French1286—
LMArena German1273—
LMArena Japanese1213—
LMArena Korean1195—
LMArena Russian1261—
LMArena Spanish1279—

Instruction Following Not comparable

Grok 2 Mini 2024 08 13: 65.5 (#220), Hy4 preview: —

Instruction Following benchmarks
BenchmarkGrok 2 Mini 2024 08 13Hy4 preview
LMArena Instruction Following1245—

Long Context Not comparable

Grok 2 Mini 2024 08 13: 38.4 (#196), Hy4 preview: —

Long Context benchmarks
BenchmarkGrok 2 Mini 2024 08 13Hy4 preview
LMArena Longer Query1266—

Writing & Preference Not comparable

Grok 2 Mini 2024 08 13: 47.3 (#211), Hy4 preview: —

Writing & Preference benchmarks
BenchmarkGrok 2 Mini 2024 08 13Hy4 preview
LMArena Text1281—
LMArena Creative Writing1242—
LMArena Multi-Turn1265—

Frequently asked questions

Is Grok 2 Mini 2024 08 13 better than Hy4 preview?

Hy4 preview is the stronger model overall, scoring 45.3 to 37.7 on the Noometry Index.

Is Grok 2 Mini 2024 08 13 or Hy4 preview better for coding?

Hy4 preview scores higher on coding benchmarks: 51.6 versus 37.0 in the Noometry coding category.

How many benchmarks do Grok 2 Mini 2024 08 13 and Hy4 preview share?

0 benchmarks have published results for both models. Grok 2 Mini 2024 08 13 has 17 scored results on Noometry and Hy4 preview has 3.

Related comparisons

Go deeper