Model comparison

Grok 4.20 (Non-Reasoning) vs Hy3

Grok 4.20 (Non-Reasoning) is the stronger model overall, scoring 48.6 to 44.2 on the Noometry Index. Hy3 costs 11× less per token, which makes it the better buy when Grok 4.20 (Non-Reasoning)'s lead doesn't matter for your workload.

Last verified . 19 shared benchmarks.

Grok 4.20 (Non-Reasoning) xAI

48.6

Rank #54 Confirmed

Hy3 Tencent

44.2

Rank #79 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Grok 4.20 (Non-Reasoning) scores higher in 6 categories and Hy3 in 2 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Grok 4.20 (Non-Reasoning) leads 52.3 to 26.1.
  • The biggest single-benchmark swing is NYT Connections (extended): 85.4% for Grok 4.20 (Non-Reasoning) and 41.2% for Hy3.
  • Hy3 is cheaper at $0.0825 / $0.33 per million input/output tokens, against $1.25 / $2.50 for Grok 4.20 (Non-Reasoning).
  • Grok 4.20 (Non-Reasoning) accepts more context: 1M tokens versus 262K.
  • Hy3 has downloadable open weights; the other is API-only.

Side by side

Grok 4.20 (Non-Reasoning) and Hy3 specifications
Grok 4.20 (Non-Reasoning)Hy3
ProviderxAITencent
Noometry Index48.644.2
Released2026-02-172026-07-06
WeightsProprietaryOpen
Context window1M262K
Max output30K128K
Input $ / M tokens$1.25$0.0825
Output $ / M tokens$2.50$0.33
Results tracked4619

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hy3 leads

Grok 4.20 (Non-Reasoning): 42.1 (#112), Hy3: 46.8 (#63)

Coding benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)Hy3
LMArena WebDev13751508
LMArena Coding14591464
WeirdML52.3%—
ALE-Bench1,150—

Agentic & Tool Use Not comparable

Grok 4.20 (Non-Reasoning): 34.4 (#46), Hy3: —

Agentic & Tool Use benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)Hy3
Terminal-Bench57.3%—
τ²-bench Banking18%—
LMArena Search1189—
Vending-Bench 24,663—

Reasoning Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 52.3 (#32), Hy3: 26.1 (#136)

Reasoning benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)Hy3
NYT Connections (extended)85.4%41.2%
LMArena Hard Prompts14511447
ARC-AGI-265.1%—
Kagi LLM Benchmark75%—
ARC-AGI-189.5%—
Chess Puzzles24%—
Thematic Generalization63.8%—
DTBench90.1%—
LMCA38.7%—
Epoch Capabilities Index151.98—
ForecastBench61.4—

Math Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 48.2 (#65), Hy3: 40.1 (#93)

Math benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)Hy3
LMArena Math14551475
FrontierMath (Tiers 1-3)44.9%—
FrontierMath Tier 417.1%—
OTIS Mock AIME 2024-202592.2%—
ProofBench14%—

Knowledge Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 52.8 (#60), Hy3: 40.8 (#114)

Knowledge benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)Hy3
LMArena Expert14391460
GPQA Diamond89.3%—
SimpleQA Verified30.2%—

Multimodal Not comparable

Grok 4.20 (Non-Reasoning): 33.3 (#98), Hy3: —

Multimodal benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)Hy3
LMArena Vision1263—
Blueprint-Bench 20%—
LMArena Document1416—

Multilingual Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 54.5 (#40), Hy3: 53.5 (#65)

Multilingual benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)Hy3
LMArena Non-English14411426
LMArena Chinese14811493
LMArena French14761461
LMArena German14651439
LMArena Japanese14491392
LMArena Korean14171395
LMArena Russian14581432
LMArena Spanish14431456

Instruction Following Too close to call

Grok 4.20 (Non-Reasoning): 74.8 (#83), Hy3: 75.1 (#70)

Instruction Following benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)Hy3
LMArena Instruction Following14201426

Long Context Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 45.5 (#34), Hy3: 44.1 (#75)

Long Context benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)Hy3
LMArena Longer Query14371442
CL-bench22.2%—
CL-bench Life11.9%—

Writing & Preference Grok 4.20 (Non-Reasoning) leads

Grok 4.20 (Non-Reasoning): 65.7 (#44), Hy3: 62.2 (#81)

Writing & Preference benchmarks
BenchmarkGrok 4.20 (Non-Reasoning)Hy3
LMArena Text14511439
LMArena Creative Writing14381402
LMArena Multi-Turn14561436
EQ-Bench Creative Writing1574—

Frequently asked questions

Is Grok 4.20 (Non-Reasoning) better than Hy3?

Grok 4.20 (Non-Reasoning) is the stronger model overall, scoring 48.6 to 44.2 on the Noometry Index. Hy3 costs 11× less per token, which makes it the better buy when Grok 4.20 (Non-Reasoning)'s lead doesn't matter for your workload.

Which is cheaper, Grok 4.20 (Non-Reasoning) or Hy3?

Hy3 is cheaper. It lists at $0.0825 per million input tokens and $0.33 per million output tokens; Grok 4.20 (Non-Reasoning) lists at $1.25 and $2.50.

Is Grok 4.20 (Non-Reasoning) or Hy3 better for coding?

Hy3 scores higher on coding benchmarks: 46.8 versus 42.1 in the Noometry coding category.

Which has the bigger context window?

Grok 4.20 (Non-Reasoning) does, with 1M tokens against 262K.

How many benchmarks do Grok 4.20 (Non-Reasoning) and Hy3 share?

19 benchmarks have published results for both models. Grok 4.20 (Non-Reasoning) has 46 scored results on Noometry and Hy3 has 19.

Related comparisons

Go deeper