Model comparison

Claude 2.1 vs Hunyuan Vision 1.5

Hunyuan Vision 1.5 is the stronger model overall, scoring 43.1 to 25.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude 2.1 Anthropic

25.2

Rank #345 Reported

Hunyuan Vision 1.5 Tencent

43.1

Rank #98 Confirmed

Summary

  • The widest gap is in coding, where Hunyuan Vision 1.5 leads 41.8 to 26.2.

Side by side

Claude 2.1 and Hunyuan Vision 1.5 specifications
Claude 2.1Hunyuan Vision 1.5
ProviderAnthropicTencent
Noometry Index25.243.1
Released2023-11-21—
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked79

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hunyuan Vision 1.5 leads

Claude 2.1: 26.2 (#327), Hunyuan Vision 1.5: 41.8 (#119)

Coding benchmarks
BenchmarkClaude 2.1Hunyuan Vision 1.5
WeirdML7.1%—
LMArena Coding—1418

Reasoning Hunyuan Vision 1.5 leads

Claude 2.1: 21.4 (#221), Hunyuan Vision 1.5: 28.9 (#97)

Reasoning benchmarks
BenchmarkClaude 2.1Hunyuan Vision 1.5
LMArena Hard Prompts—1416
DTBench51%—
Epoch Capabilities Index119.27—
ForecastBench54.2—

Math Not comparable

Claude 2.1: 10.2 (#315), Hunyuan Vision 1.5: —

Math benchmarks
BenchmarkClaude 2.1Hunyuan Vision 1.5
OTIS Mock AIME 2024-20251.9%—

Knowledge Not comparable

Claude 2.1: 15.4 (#292), Hunyuan Vision 1.5: —

Knowledge benchmarks
BenchmarkClaude 2.1Hunyuan Vision 1.5
GPQA Diamond33%—
MMLU73.5%—

Multimodal Not comparable

Claude 2.1: —, Hunyuan Vision 1.5: 35.7 (#84)

Multimodal benchmarks
BenchmarkClaude 2.1Hunyuan Vision 1.5
LMArena Vision—1180

Multilingual Not comparable

Claude 2.1: —, Hunyuan Vision 1.5: 50.3 (#125)

Multilingual benchmarks
BenchmarkClaude 2.1Hunyuan Vision 1.5
LMArena Non-English—1382

Instruction Following Not comparable

Claude 2.1: —, Hunyuan Vision 1.5: 73.7 (#117)

Instruction Following benchmarks
BenchmarkClaude 2.1Hunyuan Vision 1.5
LMArena Instruction Following—1397

Long Context Not comparable

Claude 2.1: —, Hunyuan Vision 1.5: 42.9 (#115)

Long Context benchmarks
BenchmarkClaude 2.1Hunyuan Vision 1.5
LMArena Longer Query—1404

Writing & Preference Not comparable

Claude 2.1: —, Hunyuan Vision 1.5: 60.1 (#100)

Writing & Preference benchmarks
BenchmarkClaude 2.1Hunyuan Vision 1.5
LMArena Text—1405
LMArena Creative Writing—1388
LMArena Multi-Turn—1422

Frequently asked questions

Is Claude 2.1 better than Hunyuan Vision 1.5?

Hunyuan Vision 1.5 is the stronger model overall, scoring 43.1 to 25.2 on the Noometry Index.

Is Claude 2.1 or Hunyuan Vision 1.5 better for coding?

Hunyuan Vision 1.5 scores higher on coding benchmarks: 41.8 versus 26.2 in the Noometry coding category.

How many benchmarks do Claude 2.1 and Hunyuan Vision 1.5 share?

0 benchmarks have published results for both models. Claude 2.1 has 7 scored results on Noometry and Hunyuan Vision 1.5 has 9.

Related comparisons

Go deeper