Noometry

Model comparison

Hunyuan T1 20250711 vs o3

o3 is the stronger model overall, scoring 47.5 to 42.5 on the Noometry Index.

Last verified . 13 shared benchmarks.

Hunyuan T1 20250711 Tencent

42.5

Rank #114 Confirmed

o3 OpenAI

47.5

Rank #61 Confirmed

Summary

  • They share 13 benchmarks with published results for both. Hunyuan T1 20250711 scores higher in 0 categories and o3 in 8 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where o3 leads 54.6 to 38.8.

Side by side

Hunyuan T1 20250711o3
ProviderTencentOpenAI
Noometry Index42.547.5
Released—2025-04-16
WeightsProprietaryProprietary
Context window—200K
Max output—100K
Input $ / M tokens—$2
Output $ / M tokens—$8
Results tracked1363

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding o3 leads

Hunyuan T1 20250711: 40.9 (#129), o3: 46.8 (#64)

BenchmarkHunyuan T1 20250711o3
LMArena Coding13901408
SWE-bench Verified—62.3%
SWE-bench Verified (bash only)—58.4%
Aider Polyglot—81.3%
GSO—8.8%
WeirdML—52.4%
CadEval—74%
ALE-Bench—933.55

Agentic & Tool Use Not comparable

Hunyuan T1 20250711: —, o3: 34.5 (#44)

BenchmarkHunyuan T1 20250711o3
Berkeley Function Calling Leaderboard—63%
GDPval—30.8%
DeepResearch Bench—45.2%
OSWorld—23%
LMArena Search—1144
METR Time Horizons—65.4%

Reasoning o3 leads

Hunyuan T1 20250711: 28.5 (#103), o3: 32.0 (#78)

BenchmarkHunyuan T1 20250711o3
LMArena Hard Prompts13991402
ARC-AGI-2—6.5%
SimpleBench—53.1%
Kagi LLM Benchmark—67.6%
ARC-AGI-1—60.8%
CritPt—1.4%
Chess Puzzles—38%
EnigmaEval—13.1%
Mystery Game Puzzles—29%
DTBench—84.8%
LMCA—39.7%
Epoch Capabilities Index—146.86
ForecastBench—62.5

Math o3 leads

Hunyuan T1 20250711: 38.7 (#130), o3: 50.2 (#58)

BenchmarkHunyuan T1 20250711o3
LMArena Math14141426
FrontierMath (Tiers 1-3)—33.3%
OTIS Mock AIME 2024-2025—84.4%
Omni-MATH—71.4%
MATH Level 5—97.8%
FrontierMath (Feb 2025 set)—18.7%
FrontierMath Tier 4 (v1)—2.1%

Knowledge o3 leads

Hunyuan T1 20250711: 38.8 (#141), o3: 54.6 (#52)

BenchmarkHunyuan T1 20250711o3
LMArena Expert13951402
GPQA Diamond—81.8%
Humanity's Last Exam—20.3%
SimpleQA Verified—49.4%
MMLU-Pro—85.9%
Confabulations—14.4%
GPQA (HELM)—75.3%

Multimodal Not comparable

Hunyuan T1 20250711: —, o3: 41.4 (#36)

BenchmarkHunyuan T1 20250711o3
LMArena Vision—1214
GeoBench—74%
VPCT—52%

Multilingual Too close to call

Hunyuan T1 20250711: 51.2 (#112), o3: 51.7 (#105)

BenchmarkHunyuan T1 20250711o3
LMArena Non-English13951401
LMArena Chinese14251437
LMArena Korean14061370
LMArena Russian13851406
LMArena French—1430
LMArena German—1420
LMArena Japanese—1403
LMArena Spanish—1395

Instruction Following Too close to call

Hunyuan T1 20250711: 72.6 (#138), o3: 72.8 (#127)

BenchmarkHunyuan T1 20250711o3
LMArena Instruction Following13741368
IFEval—86.9%

Long Context o3 leads

Hunyuan T1 20250711: 42.2 (#128), o3: 53.3 (#6)

BenchmarkHunyuan T1 20250711o3
LMArena Longer Query13841372
Fiction.LiveBench—88.9%
CL-bench—17.8%

Writing & Preference o3 leads

Hunyuan T1 20250711: 59.5 (#109), o3: 63.5 (#64)

BenchmarkHunyuan T1 20250711o3
LMArena Text14011410
LMArena Creative Writing13921359
LMArena Multi-Turn13931405
Short-Story Creative Writing—83.9%
EQ-Bench Creative Writing—1676
WildBench—86.1%

Frequently asked questions

Is Hunyuan T1 20250711 better than o3?

o3 is the stronger model overall, scoring 47.5 to 42.5 on the Noometry Index.

Is Hunyuan T1 20250711 or o3 better for coding?

o3 scores higher on coding benchmarks: 46.8 versus 40.9 in the Noometry coding category.

How many benchmarks do Hunyuan T1 20250711 and o3 share?

13 benchmarks have published results for both models. Hunyuan T1 20250711 has 13 scored results on Noometry and o3 has 63.

Related comparisons

Go deeper