Model comparison

Claude 2 vs Hunyuan Vision 1.5

Hunyuan Vision 1.5 is the stronger model overall, scoring 42.6 to 24.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude 2 Anthropic

24.7

Rank #342 Reported

Hunyuan Vision 1.5 Tencent

42.6

Rank #95 Confirmed

Summary

  • The widest gap is in reasoning, where Hunyuan Vision 1.5 leads 27.8 to 20.8.

Side by side

Claude 2 and Hunyuan Vision 1.5 specifications
Claude 2Hunyuan Vision 1.5
ProviderAnthropicTencent
Noometry Index24.742.6
Released2023-07-11—
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked89

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude 2: —, Hunyuan Vision 1.5: 41.2 (#119)

Coding benchmarks
BenchmarkClaude 2Hunyuan Vision 1.5
LMArena Coding—1419
HumanEval+61.6%—

Reasoning Hunyuan Vision 1.5 leads

Claude 2: 20.8 (#213), Hunyuan Vision 1.5: 27.8 (#96)

Reasoning benchmarks
BenchmarkClaude 2Hunyuan Vision 1.5
LMArena Hard Prompts—1417
DTBench51.9%—
Epoch Capabilities Index120.08—

Math Not comparable

Claude 2: 8.7 (#314), Hunyuan Vision 1.5: —

Math benchmarks
BenchmarkClaude 2Hunyuan Vision 1.5
OTIS Mock AIME 2024-20252.5%—
MATH Level 511.7%—

Knowledge Not comparable

Claude 2: 17.0 (#282), Hunyuan Vision 1.5: —

Knowledge benchmarks
BenchmarkClaude 2Hunyuan Vision 1.5
GPQA Diamond34.7%—
MMLU78.5%—
TriviaQA87.5%—

Multimodal Not comparable

Claude 2: —, Hunyuan Vision 1.5: 35.1 (#78)

Multimodal benchmarks
BenchmarkClaude 2Hunyuan Vision 1.5
LMArena Vision—1180

Multilingual Not comparable

Claude 2: —, Hunyuan Vision 1.5: 50.5 (#118)

Multilingual benchmarks
BenchmarkClaude 2Hunyuan Vision 1.5
LMArena Non-English—1383

Instruction Following Not comparable

Claude 2: —, Hunyuan Vision 1.5: 73.9 (#110)

Instruction Following benchmarks
BenchmarkClaude 2Hunyuan Vision 1.5
LMArena Instruction Following—1398

Long Context Not comparable

Claude 2: —, Hunyuan Vision 1.5: 42.9 (#110)

Long Context benchmarks
BenchmarkClaude 2Hunyuan Vision 1.5
LMArena Longer Query—1405

Writing & Preference Not comparable

Claude 2: —, Hunyuan Vision 1.5: 60.4 (#95)

Writing & Preference benchmarks
BenchmarkClaude 2Hunyuan Vision 1.5
LMArena Text—1407
LMArena Creative Writing—1389
LMArena Multi-Turn—1423

Frequently asked questions

Is Claude 2 better than Hunyuan Vision 1.5?

Hunyuan Vision 1.5 is the stronger model overall, scoring 42.6 to 24.7 on the Noometry Index.

How many benchmarks do Claude 2 and Hunyuan Vision 1.5 share?

0 benchmarks have published results for both models. Claude 2 has 8 scored results on Noometry and Hunyuan Vision 1.5 has 9.

Related comparisons

Go deeper