Noometry

Model comparison

Longcat Flash Chat vs Qwen2.5-VL 72B Instruct

Longcat Flash Chat is the stronger model overall, scoring 41.5 to 29.4 on the Noometry Index.

Last verified . 1 shared benchmarks.

Longcat Flash Chat Meituan

41.5

Rank #121 Confirmed

Qwen2.5-VL 72B Instruct Alibaba (Qwen)

29.4

Rank #298 Confirmed

Summary

  • They share 1 benchmark with published results for both. Longcat Flash Chat scores higher in 0 categories and Qwen2.5-VL 72B Instruct in 1 category; one gap is clear of the uncertainty.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 43.9% for Longcat Flash Chat and 36% for Qwen2.5-VL 72B Instruct.

Side by side

Longcat Flash ChatQwen2.5-VL 72B Instruct
ProviderMeituanAlibaba (Qwen)
Noometry Index41.529.4
Released—2024-09
WeightsOpenOpen
Context window—131K
Max output—8K
Input $ / M tokens—$2.80
Output $ / M tokens—$8.40
Results tracked196

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Longcat Flash Chat: 42.9 (#85), Qwen2.5-VL 72B Instruct: —

BenchmarkLongcat Flash ChatQwen2.5-VL 72B Instruct
LMArena Coding1471—

Agentic & Tool Use Not comparable

Longcat Flash Chat: —, Qwen2.5-VL 72B Instruct: 18.4 (#136)

BenchmarkLongcat Flash ChatQwen2.5-VL 72B Instruct
OSWorld—5%

Reasoning Qwen2.5-VL 72B Instruct leads

Longcat Flash Chat: 18.3 (#267), Qwen2.5-VL 72B Instruct: 20.0 (#228)

BenchmarkLongcat Flash ChatQwen2.5-VL 72B Instruct
Kagi LLM Benchmark43.9%36%
NYT Connections (extended)17.7%—
LMArena Hard Prompts1440—

Math Not comparable

Longcat Flash Chat: 36.6 (#107), Qwen2.5-VL 72B Instruct: —

BenchmarkLongcat Flash ChatQwen2.5-VL 72B Instruct
LMArena Math1441—

Knowledge Not comparable

Longcat Flash Chat: 40.0 (#111), Qwen2.5-VL 72B Instruct: —

BenchmarkLongcat Flash ChatQwen2.5-VL 72B Instruct
LMArena Expert1454—

Multimodal Not comparable

Longcat Flash Chat: —, Qwen2.5-VL 72B Instruct: 32.9 (#92)

BenchmarkLongcat Flash ChatQwen2.5-VL 72B Instruct
LMArena Vision—1107
Video-MME—73.5%
GeoBench—62%
SpatialViz-Bench—33.3%

Multilingual Not comparable

Longcat Flash Chat: 52.1 (#95), Qwen2.5-VL 72B Instruct: —

BenchmarkLongcat Flash ChatQwen2.5-VL 72B Instruct
LMArena Non-English1404—
LMArena Chinese1465—
LMArena French1457—
LMArena German1409—
LMArena Japanese1373—
LMArena Korean1372—
LMArena Russian1396—
LMArena Spanish1445—

Instruction Following Not comparable

Longcat Flash Chat: 74.6 (#92), Qwen2.5-VL 72B Instruct: —

BenchmarkLongcat Flash ChatQwen2.5-VL 72B Instruct
LMArena Instruction Following1411—

Long Context Not comparable

Longcat Flash Chat: 43.5 (#89), Qwen2.5-VL 72B Instruct: —

BenchmarkLongcat Flash ChatQwen2.5-VL 72B Instruct
LMArena Longer Query1425—

Writing & Preference Not comparable

Longcat Flash Chat: 61.2 (#88), Qwen2.5-VL 72B Instruct: —

BenchmarkLongcat Flash ChatQwen2.5-VL 72B Instruct
LMArena Text1427—
LMArena Creative Writing1388—
LMArena Multi-Turn1418—

Frequently asked questions

Is Longcat Flash Chat better than Qwen2.5-VL 72B Instruct?

Longcat Flash Chat is the stronger model overall, scoring 41.5 to 29.4 on the Noometry Index.

How many benchmarks do Longcat Flash Chat and Qwen2.5-VL 72B Instruct share?

1 benchmark has published results for both models. Longcat Flash Chat has 19 scored results on Noometry and Qwen2.5-VL 72B Instruct has 6.

Related comparisons

Go deeper