Model comparison

GPT-3.5-turbo vs Hunyuan Turbo 0110

Hunyuan Turbo 0110 is the stronger model overall, scoring 39.6 to 23.2 on the Noometry Index.

Last verified . 11 shared benchmarks.

GPT-3.5-turbo OpenAI

23.2

Rank #350 Confirmed

Hunyuan Turbo 0110 Tencent

39.6

Rank #163 Confirmed

Summary

  • They share 11 benchmarks with published results for both. GPT-3.5-turbo scores higher in 0 categories and Hunyuan Turbo 0110 in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where Hunyuan Turbo 0110 leads 35.6 to 6.3.

Side by side

GPT-3.5-turbo and Hunyuan Turbo 0110 specifications
GPT-3.5-turboHunyuan Turbo 0110
ProviderOpenAITencent
Noometry Index23.239.6
Released2023-03-01—
WeightsProprietaryProprietary
Context window16K—
Max output4K—
Input $ / M tokens$0.50—
Output $ / M tokens$1.50—
Results tracked4411

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hunyuan Turbo 0110 leads

GPT-3.5-turbo: 23.9 (#331), Hunyuan Turbo 0110: 38.6 (#171)

Coding benchmarks
BenchmarkGPT-3.5-turboHunyuan Turbo 0110
LMArena Coding11361319
WeirdML3.5%—
BigCodeBench Instruct39.1%—
BigCodeBench Complete50.6%—
HumanEval+70.7%—
MBPP+69.7%—

Agentic & Tool Use Not comparable

GPT-3.5-turbo: —, Hunyuan Turbo 0110: —

Agentic & Tool Use benchmarks
BenchmarkGPT-3.5-turboHunyuan Turbo 0110
METR Time Horizons21.5%—

Reasoning Hunyuan Turbo 0110 leads

GPT-3.5-turbo: 13.8 (#332), Hunyuan Turbo 0110: 26.1 (#137)

Reasoning benchmarks
BenchmarkGPT-3.5-turboHunyuan Turbo 0110
LMArena Hard Prompts11081308
Chess Puzzles0%—
Mystery Game Puzzles3%—
DTBench48.5%—
LMCA9.7%—
Adversarial NLI58.1%—
BIG-Bench Hard61.6%—
CommonsenseQA 2.057%—
Epoch Capabilities Index118.55—
ForecastBench50.4—
WinoGrande81.6%—

Math Hunyuan Turbo 0110 leads

GPT-3.5-turbo: 6.3 (#327), Hunyuan Turbo 0110: 35.6 (#180)

Math benchmarks
BenchmarkGPT-3.5-turboHunyuan Turbo 0110
LMArena Math11421273
FrontierMath (Tiers 1-3)0%—
OTIS Mock AIME 2024-20252.2%—
MATH Level 515.9%—
GSM8K57.8%—

Knowledge Not comparable

GPT-3.5-turbo: 10.0 (#303), Hunyuan Turbo 0110: —

Knowledge benchmarks
BenchmarkGPT-3.5-turboHunyuan Turbo 0110
GPQA Diamond28%—
LMArena Expert1070—
ARC (AI2) Challenge87.4%—
BoolQ87%—
MMLU71.4%—
OpenBookQA86%—
TriviaQA85.8%—

Multilingual Hunyuan Turbo 0110 leads

GPT-3.5-turbo: 31.5 (#258), Hunyuan Turbo 0110: 43.3 (#184)

Multilingual benchmarks
BenchmarkGPT-3.5-turboHunyuan Turbo 0110
LMArena Non-English11081285
LMArena Chinese10751358
LMArena Russian11231305
LMArena French1118—
LMArena German1090—
LMArena Japanese1043—
LMArena Korean1019—
LMArena Spanish1121—

Instruction Following Hunyuan Turbo 0110 leads

GPT-3.5-turbo: 57.9 (#262), Hunyuan Turbo 0110: 67.4 (#195)

Instruction Following benchmarks
BenchmarkGPT-3.5-turboHunyuan Turbo 0110
LMArena Instruction Following11191278

Long Context Hunyuan Turbo 0110 leads

GPT-3.5-turbo: 34.0 (#254), Hunyuan Turbo 0110: 39.8 (#168)

Long Context benchmarks
BenchmarkGPT-3.5-turboHunyuan Turbo 0110
LMArena Longer Query11211309

Writing & Preference Hunyuan Turbo 0110 leads

GPT-3.5-turbo: 25.3 (#305), Hunyuan Turbo 0110: 50.2 (#183)

Writing & Preference benchmarks
BenchmarkGPT-3.5-turboHunyuan Turbo 0110
LMArena Text11251311
LMArena Creative Writing10921269
LMArena Multi-Turn11171303
EQ-Bench Creative Writing451—

Frequently asked questions

Is GPT-3.5-turbo better than Hunyuan Turbo 0110?

Hunyuan Turbo 0110 is the stronger model overall, scoring 39.6 to 23.2 on the Noometry Index.

Is GPT-3.5-turbo or Hunyuan Turbo 0110 better for coding?

Hunyuan Turbo 0110 scores higher on coding benchmarks: 38.6 versus 23.9 in the Noometry coding category.

How many benchmarks do GPT-3.5-turbo and Hunyuan Turbo 0110 share?

11 benchmarks have published results for both models. GPT-3.5-turbo has 44 scored results on Noometry and Hunyuan Turbo 0110 has 11.

Related comparisons

Go deeper