Model comparison

Claude 2.1 vs Hunyuan Large Vision

Hunyuan Large Vision is the stronger model overall, scoring 37.0 to 24.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Claude 2.1 Anthropic

24.9

Rank #340 Reported

Hunyuan Large Vision Tencent

37.0

Rank #198 Confirmed

Summary

  • The widest gap is in math, where Hunyuan Large Vision leads 32.8 to 9.6.

Side by side

Claude 2.1 and Hunyuan Large Vision specifications
Claude 2.1Hunyuan Large Vision
ProviderAnthropicTencent
Noometry Index24.937.0
Released2023-11-21—
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked713

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hunyuan Large Vision leads

Claude 2.1: 25.8 (#322), Hunyuan Large Vision: 37.6 (#176)

Coding benchmarks
BenchmarkClaude 2.1Hunyuan Large Vision
WeirdML7.1%—
LMArena Coding—1307

Reasoning Hunyuan Large Vision leads

Claude 2.1: 20.6 (#216), Hunyuan Large Vision: 23.8 (#160)

Reasoning benchmarks
BenchmarkClaude 2.1Hunyuan Large Vision
LMArena Hard Prompts—1257
DTBench51%—
Epoch Capabilities Index119.22—
ForecastBench54.2—

Math Hunyuan Large Vision leads

Claude 2.1: 9.6 (#309), Hunyuan Large Vision: 32.8 (#184)

Math benchmarks
BenchmarkClaude 2.1Hunyuan Large Vision
OTIS Mock AIME 2024-20251.9%—
LMArena Math—1269

Knowledge Hunyuan Large Vision leads

Claude 2.1: 15.5 (#287), Hunyuan Large Vision: 33.7 (#191)

Knowledge benchmarks
BenchmarkClaude 2.1Hunyuan Large Vision
GPQA Diamond33%—
LMArena Expert—1250
MMLU73.5%—

Multimodal Not comparable

Claude 2.1: —, Hunyuan Large Vision: 35.1 (#79)

Multimodal benchmarks
BenchmarkClaude 2.1Hunyuan Large Vision
LMArena Vision—1180

Multilingual Not comparable

Claude 2.1: —, Hunyuan Large Vision: 40.1 (#216)

Multilingual benchmarks
BenchmarkClaude 2.1Hunyuan Large Vision
LMArena Non-English—1236
LMArena Chinese—1289
LMArena Russian—1243

Instruction Following Not comparable

Claude 2.1: —, Hunyuan Large Vision: 66.0 (#210)

Instruction Following benchmarks
BenchmarkClaude 2.1Hunyuan Large Vision
LMArena Instruction Following—1250

Long Context Not comparable

Claude 2.1: —, Hunyuan Large Vision: 38.8 (#184)

Long Context benchmarks
BenchmarkClaude 2.1Hunyuan Large Vision
LMArena Longer Query—1279

Writing & Preference Not comparable

Claude 2.1: —, Hunyuan Large Vision: 46.7 (#211)

Writing & Preference benchmarks
BenchmarkClaude 2.1Hunyuan Large Vision
LMArena Text—1263
LMArena Creative Writing—1250
LMArena Multi-Turn—1253

Frequently asked questions

Is Claude 2.1 better than Hunyuan Large Vision?

Hunyuan Large Vision is the stronger model overall, scoring 37.0 to 24.9 on the Noometry Index.

Is Claude 2.1 or Hunyuan Large Vision better for coding?

Hunyuan Large Vision scores higher on coding benchmarks: 37.6 versus 25.8 in the Noometry coding category.

How many benchmarks do Claude 2.1 and Hunyuan Large Vision share?

0 benchmarks have published results for both models. Claude 2.1 has 7 scored results on Noometry and Hunyuan Large Vision has 13.

Related comparisons

Go deeper