Noometry

Model comparison

GPT-4o mini vs Hy3

Hy3 is the stronger model overall, scoring 44.2 to 25.5 on the Noometry Index.

Last verified . 17 shared benchmarks.

GPT-4o mini OpenAI

25.5

Rank #343 Confirmed

Hy3 Tencent

44.2

Rank #79 Confirmed

Summary

  • They share 17 benchmarks with published results for both. GPT-4o mini scores higher in 0 categories and Hy3 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Hy3 leads 40.1 to 10.4.
  • Hy3 is cheaper at $0.0825 / $0.33 per million input/output tokens, against $0.15 / $0.60 for GPT-4o mini.
  • Hy3 accepts more context: 262K tokens versus 128K.
  • Hy3 has downloadable open weights; the other is API-only.

Side by side

GPT-4o miniHy3
ProviderOpenAITencent
Noometry Index25.544.2
Released2024-07-182026-07-06
WeightsProprietaryOpen
Context window128K262K
Max output16K128K
Input $ / M tokens$0.15$0.0825
Output $ / M tokens$0.60$0.33
Results tracked6019

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hy3 leads

GPT-4o mini: 22.0 (#335), Hy3: 46.8 (#63)

BenchmarkGPT-4o miniHy3
LMArena Coding12901464
Aider Polyglot3.6%—
LMArena WebDev—1508
WeirdML11.8%—
BigCodeBench Instruct46.1%—
LiveBench Coding43.1%—
BigCodeBench Complete57.4%—
HumanEval+83.5%—
MBPP+72.2%—

Agentic & Tool Use Not comparable

GPT-4o mini: 27.5 (#101), Hy3: —

BenchmarkGPT-4o miniHy3
BALROG17.4%—

Reasoning Hy3 leads

GPT-4o mini: 8.7 (#347), Hy3: 26.1 (#136)

BenchmarkGPT-4o miniHy3
LMArena Hard Prompts12671447
ARC-AGI-20%—
SimpleBench10.7%—
Kagi LLM Benchmark28.8%—
NYT Connections (extended)—41.2%
Chess Puzzles0%—
LiveBench Reasoning32.8%—
Mystery Game Puzzles12%—
DTBench54.4%—
LiveBench Data Analysis50%—
LMCA10.4%—
Epoch Capabilities Index126.56—
LiveBench41.3%—
PIQA88.7%—

Math Hy3 leads

GPT-4o mini: 10.4 (#314), Hy3: 40.1 (#93)

BenchmarkGPT-4o miniHy3
LMArena Math12671475
FrontierMath (Tiers 1-3)0.7%—
OTIS Mock AIME 2024-20256.9%—
Omni-MATH28%—
LiveBench Math36.3%—
MATH Level 552.6%—
GSM8K91.3%—

Knowledge Hy3 leads

GPT-4o mini: 17.7 (#284), Hy3: 40.8 (#114)

BenchmarkGPT-4o miniHy3
LMArena Expert12351460
GPQA Diamond37.7%—
SimpleQA Verified8.3%—
MMLU-Pro60.3%—
Confabulations37.2%—
GPQA (HELM)36.8%—
BoolQ88.7%—
MMLU81.8%—

Multimodal Not comparable

GPT-4o mini: 25.9 (#122), Hy3: —

BenchmarkGPT-4o miniHy3
LMArena Vision1066—
Video-MME64.8%—
GeoBench64%—
VPCT34%—

Multilingual Hy3 leads

GPT-4o mini: 42.0 (#199), Hy3: 53.5 (#65)

BenchmarkGPT-4o miniHy3
LMArena Non-English12661426
LMArena Chinese12651493
LMArena French12971461
LMArena German12721439
LMArena Japanese12161392
LMArena Korean11951395
LMArena Russian12751432
LMArena Spanish12761456

Instruction Following Hy3 leads

GPT-4o mini: 61.9 (#239), Hy3: 75.1 (#70)

BenchmarkGPT-4o miniHy3
LMArena Instruction Following12581426
LiveBench Instruction Following56.8%—
IFEval78.2%—

Long Context Hy3 leads

GPT-4o mini: 39.1 (#186), Hy3: 44.1 (#75)

BenchmarkGPT-4o miniHy3
LMArena Longer Query12891442

Writing & Preference Hy3 leads

GPT-4o mini: 39.5 (#248), Hy3: 62.2 (#81)

BenchmarkGPT-4o miniHy3
LMArena Text12861439
LMArena Creative Writing12681402
LMArena Multi-Turn12851436
Short-Story Creative Writing67.2%—
EQ-Bench Creative Writing873—
WildBench79.1%—
LiveBench Language28.6%—

Frequently asked questions

Is GPT-4o mini better than Hy3?

Hy3 is the stronger model overall, scoring 44.2 to 25.5 on the Noometry Index.

Which is cheaper, GPT-4o mini or Hy3?

Hy3 is cheaper. It lists at $0.0825 per million input tokens and $0.33 per million output tokens; GPT-4o mini lists at $0.15 and $0.60.

Is GPT-4o mini or Hy3 better for coding?

Hy3 scores higher on coding benchmarks: 46.8 versus 22.0 in the Noometry coding category.

Which has the bigger context window?

Hy3 does, with 262K tokens against 128K.

How many benchmarks do GPT-4o mini and Hy3 share?

17 benchmarks have published results for both models. GPT-4o mini has 60 scored results on Noometry and Hy3 has 19.

Related comparisons

Go deeper