Noometry

Model comparison

Hunyuan Vision 1.5 vs Phi-4

Hunyuan Vision 1.5 is the stronger model overall, scoring 43.1 to 31.2 on the Noometry Index.

Last verified . 8 shared benchmarks.

Hunyuan Vision 1.5 Tencent

43.1

Rank #98 Confirmed

Phi-4 Microsoft

31.2

Rank #279 Confirmed

Summary

  • They share 8 benchmarks with published results for both. Hunyuan Vision 1.5 scores higher in 6 categories and Phi-4 in 0 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Hunyuan Vision 1.5 leads 60.1 to 40.5.
  • Phi-4 has downloadable open weights; the other is API-only.

Side by side

Hunyuan Vision 1.5Phi-4
ProviderTencentMicrosoft
Noometry Index43.131.2
Released—2024-12-11
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.07
Output $ / M tokens—$0.14
Results tracked937

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 41.8 (#119), Phi-4: 34.4 (#239)

BenchmarkHunyuan Vision 1.5Phi-4
LMArena Coding14181231
BigCodeBench Instruct—45.5%
LiveBench Coding—30.7%
BigCodeBench Complete—55.4%

Agentic & Tool Use Not comparable

Hunyuan Vision 1.5: —, Phi-4: 22.8 (#128)

BenchmarkHunyuan Vision 1.5Phi-4
Berkeley Function Calling Leaderboard—28.8%
BALROG—11.6%

Reasoning Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 28.9 (#97), Phi-4: 17.7 (#291)

BenchmarkHunyuan Vision 1.5Phi-4
LMArena Hard Prompts14161220
Chess Puzzles—1%
LiveBench Reasoning—47.8%
LiveBench Data Analysis—45.2%
Epoch Capabilities Index—130.42
LiveBench—41.6%

Math Not comparable

Hunyuan Vision 1.5: —, Phi-4: 20.8 (#285)

BenchmarkHunyuan Vision 1.5Phi-4
OTIS Mock AIME 2024-2025—13.8%
LiveBench Math—42%
LMArena Math—1246
MATH Level 5—64.9%

Knowledge Not comparable

Hunyuan Vision 1.5: —, Phi-4: 32.6 (#209)

BenchmarkHunyuan Vision 1.5Phi-4
GPQA Diamond—56.1%
Confabulations—29.4%
Vectara Hallucination Rate—3.7%
LMArena Expert—1203
MMLU—84.8%

Multimodal Not comparable

Hunyuan Vision 1.5: 35.7 (#84), Phi-4: —

BenchmarkHunyuan Vision 1.5Phi-4
LMArena Vision1180—

Multilingual Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 50.3 (#125), Phi-4: 37.2 (#237)

BenchmarkHunyuan Vision 1.5Phi-4
LMArena Non-English13821197
LMArena Chinese—1212
LMArena French—1224
LMArena German—1222
LMArena Japanese—1158
LMArena Korean—1151
LMArena Russian—1209
LMArena Spanish—1234

Instruction Following Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 73.7 (#117), Phi-4: 60.4 (#251)

BenchmarkHunyuan Vision 1.5Phi-4
LMArena Instruction Following13971201
LiveBench Instruction Following—58.4%

Long Context Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 42.9 (#115), Phi-4: 36.9 (#226)

BenchmarkHunyuan Vision 1.5Phi-4
LMArena Longer Query14041217

Writing & Preference Hunyuan Vision 1.5 leads

Hunyuan Vision 1.5: 60.1 (#100), Phi-4: 40.5 (#244)

BenchmarkHunyuan Vision 1.5Phi-4
LMArena Text14051217
LMArena Creative Writing13881182
LMArena Multi-Turn14221206
Short-Story Creative Writing—62.6%
LiveBench Language—25.6%

Frequently asked questions

Is Hunyuan Vision 1.5 better than Phi-4?

Hunyuan Vision 1.5 is the stronger model overall, scoring 43.1 to 31.2 on the Noometry Index.

Is Hunyuan Vision 1.5 or Phi-4 better for coding?

Hunyuan Vision 1.5 scores higher on coding benchmarks: 41.8 versus 34.4 in the Noometry coding category.

How many benchmarks do Hunyuan Vision 1.5 and Phi-4 share?

8 benchmarks have published results for both models. Hunyuan Vision 1.5 has 9 scored results on Noometry and Phi-4 has 37.

Related comparisons

Go deeper