Model comparison

Command R+ vs Hunyuan Vision 1.5

Hunyuan Vision 1.5 is the stronger model overall, scoring 43.1 to 32.4 on the Noometry Index.

Last verified . 8 shared benchmarks.

Command R+ Cohere

32.4

Rank #257 Confirmed

Hunyuan Vision 1.5 Tencent

43.1

Rank #98 Confirmed

Summary

  • They share 8 benchmarks with published results for both. Command R+ scores higher in 0 categories and Hunyuan Vision 1.5 in 6 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Hunyuan Vision 1.5 leads 28.9 to 9.2.
  • Command R+ has downloadable open weights; the other is API-only.

Side by side

Command R+ and Hunyuan Vision 1.5 specifications
Command R+Hunyuan Vision 1.5
ProviderCohereTencent
Noometry Index32.443.1
Released2024-08-30—
WeightsOpenProprietary
Context window128K—
Max output4K—
Input $ / M tokens$2.50—
Output $ / M tokens$10—
Results tracked349

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hunyuan Vision 1.5 leads

Command R+: 29.1 (#309), Hunyuan Vision 1.5: 41.8 (#119)

Coding benchmarks
BenchmarkCommand R+Hunyuan Vision 1.5
LMArena Coding11871418
BigCodeBench Instruct33.8%—
LiveBench Coding19.1%—
BigCodeBench Complete41.9%—
HumanEval+56.7%—
MBPP+63.5%—

Reasoning Hunyuan Vision 1.5 leads

Command R+: 9.2 (#344), Hunyuan Vision 1.5: 28.9 (#97)

Reasoning benchmarks
BenchmarkCommand R+Hunyuan Vision 1.5
LMArena Hard Prompts11861416
SimpleBench17.4%—
LiveBench Reasoning24.8%—
DTBench54.9%—
LiveBench Data Analysis38.1%—
LMCA5%—
Epoch Capabilities Index119.34—
LiveBench31.8%—

Math Not comparable

Command R+: 28.9 (#242), Hunyuan Vision 1.5: —

Math benchmarks
BenchmarkCommand R+Hunyuan Vision 1.5
LiveBench Math21.3%—
LMArena Math1188—

Knowledge Not comparable

Command R+: 36.4 (#169), Hunyuan Vision 1.5: —

Knowledge benchmarks
BenchmarkCommand R+Hunyuan Vision 1.5
Vectara Hallucination Rate6.9%—
LMArena Expert1174—
MMLU69.4%—

Multimodal Not comparable

Command R+: —, Hunyuan Vision 1.5: 35.7 (#84)

Multimodal benchmarks
BenchmarkCommand R+Hunyuan Vision 1.5
LMArena Vision—1180

Multilingual Hunyuan Vision 1.5 leads

Command R+: 38.6 (#227), Hunyuan Vision 1.5: 50.3 (#125)

Multilingual benchmarks
BenchmarkCommand R+Hunyuan Vision 1.5
LMArena Non-English12161382
LMArena Chinese1226—
LMArena French1209—
LMArena German1216—
LMArena Japanese1166—
LMArena Korean1138—
LMArena Russian1227—
LMArena Spanish1189—

Instruction Following Hunyuan Vision 1.5 leads

Command R+: 60.0 (#254), Hunyuan Vision 1.5: 73.7 (#117)

Instruction Following benchmarks
BenchmarkCommand R+Hunyuan Vision 1.5
LMArena Instruction Following11971397
LiveBench Instruction Following57.6%—

Long Context Hunyuan Vision 1.5 leads

Command R+: 37.3 (#219), Hunyuan Vision 1.5: 42.9 (#115)

Long Context benchmarks
BenchmarkCommand R+Hunyuan Vision 1.5
LMArena Longer Query12301404

Writing & Preference Hunyuan Vision 1.5 leads

Command R+: 43.5 (#228), Hunyuan Vision 1.5: 60.1 (#100)

Writing & Preference benchmarks
BenchmarkCommand R+Hunyuan Vision 1.5
LMArena Text12291405
LMArena Creative Writing12351388
LMArena Multi-Turn12131422
LiveBench Language29.7%—

Frequently asked questions

Is Command R+ better than Hunyuan Vision 1.5?

Hunyuan Vision 1.5 is the stronger model overall, scoring 43.1 to 32.4 on the Noometry Index.

Is Command R+ or Hunyuan Vision 1.5 better for coding?

Hunyuan Vision 1.5 scores higher on coding benchmarks: 41.8 versus 29.1 in the Noometry coding category.

How many benchmarks do Command R+ and Hunyuan Vision 1.5 share?

8 benchmarks have published results for both models. Command R+ has 34 scored results on Noometry and Hunyuan Vision 1.5 has 9.

Related comparisons

Go deeper