Model comparison

Claude 2 vs Hunyuan Large Vision

Hunyuan Large Vision is the stronger model overall, scoring 37.6 to 25.0 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude 2 Anthropic

25.0

Rank #346 Reported

Hunyuan Large Vision Tencent

37.6

Rank #202 Confirmed

Summary

  • The widest gap is in math, where Hunyuan Large Vision leads 35.5 to 9.3.

Side by side

Claude 2 and Hunyuan Large Vision specifications
Claude 2Hunyuan Large Vision
ProviderAnthropicTencent
Noometry Index25.037.6
Released2023-07-11—
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked813

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Claude 2: —, Hunyuan Large Vision: 38.3 (#180)

Coding benchmarks
BenchmarkClaude 2Hunyuan Large Vision
LMArena Coding—1308
HumanEval+61.6%—

Reasoning Hunyuan Large Vision leads

Claude 2: 21.7 (#216), Hunyuan Large Vision: 24.8 (#158)

Reasoning benchmarks
BenchmarkClaude 2Hunyuan Large Vision
LMArena Hard Prompts—1257
DTBench51.9%—
Epoch Capabilities Index120.13—

Math Hunyuan Large Vision leads

Claude 2: 9.3 (#320), Hunyuan Large Vision: 35.5 (#183)

Math benchmarks
BenchmarkClaude 2Hunyuan Large Vision
OTIS Mock AIME 2024-20252.5%—
LMArena Math—1268
MATH Level 511.7%—

Knowledge Hunyuan Large Vision leads

Claude 2: 16.9 (#287), Hunyuan Large Vision: 34.4 (#196)

Knowledge benchmarks
BenchmarkClaude 2Hunyuan Large Vision
GPQA Diamond34.7%—
LMArena Expert—1252
MMLU78.5%—
TriviaQA87.5%—

Multimodal Not comparable

Claude 2: —, Hunyuan Large Vision: 35.7 (#83)

Multimodal benchmarks
BenchmarkClaude 2Hunyuan Large Vision
LMArena Vision—1180

Multilingual Not comparable

Claude 2: —, Hunyuan Large Vision: 39.9 (#221)

Multilingual benchmarks
BenchmarkClaude 2Hunyuan Large Vision
LMArena Non-English—1236
LMArena Chinese—1287
LMArena Russian—1243

Instruction Following Not comparable

Claude 2: —, Hunyuan Large Vision: 65.8 (#215)

Instruction Following benchmarks
BenchmarkClaude 2Hunyuan Large Vision
LMArena Instruction Following—1251

Long Context Not comparable

Claude 2: —, Hunyuan Large Vision: 38.9 (#189)

Long Context benchmarks
BenchmarkClaude 2Hunyuan Large Vision
LMArena Longer Query—1280

Writing & Preference Not comparable

Claude 2: —, Hunyuan Large Vision: 46.5 (#218)

Writing & Preference benchmarks
BenchmarkClaude 2Hunyuan Large Vision
LMArena Text—1263
LMArena Creative Writing—1248
LMArena Multi-Turn—1254

Frequently asked questions

Is Claude 2 better than Hunyuan Large Vision?

Hunyuan Large Vision is the stronger model overall, scoring 37.6 to 25.0 on the Noometry Index.

How many benchmarks do Claude 2 and Hunyuan Large Vision share?

0 benchmarks have published results for both models. Claude 2 has 8 scored results on Noometry and Hunyuan Large Vision has 13.

Related comparisons

Go deeper