Model comparison

Longcat Flash Chat vs Phi-4 Mini

Longcat Flash Chat is the stronger model overall, scoring 42.1 to 30.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Longcat Flash Chat Meituan

42.1

Rank #120 Confirmed

Phi-4 Mini Microsoft

30.9

Rank #283 Reported

Summary

  • The widest gap is in coding, where Longcat Flash Chat leads 43.5 to 28.1.

Side by side

Longcat Flash Chat and Phi-4 Mini specifications
Longcat Flash ChatPhi-4 Mini
ProviderMeituanMicrosoft
Noometry Index42.130.9
Released—2024-12-11
WeightsOpenOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.075
Output $ / M tokens—$0.30
Results tracked193

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Longcat Flash Chat leads

Longcat Flash Chat: 43.5 (#87), Phi-4 Mini: 28.1 (#317)

Coding benchmarks
BenchmarkLongcat Flash ChatPhi-4 Mini
SciCode—10.8%
LMArena Coding1471—

Reasoning Phi-4 Mini leads

Longcat Flash Chat: 19.0 (#272), Phi-4 Mini: 22.4 (#195)

Reasoning benchmarks
BenchmarkLongcat Flash ChatPhi-4 Mini
Kagi LLM Benchmark43.9%—
NYT Connections (extended)17.7%—
CritPt—0%
LMArena Hard Prompts1440—

Math Not comparable

Longcat Flash Chat: 39.4 (#107), Phi-4 Mini: —

Math benchmarks
BenchmarkLongcat Flash ChatPhi-4 Mini
LMArena Math1442—

Knowledge Longcat Flash Chat leads

Longcat Flash Chat: 40.6 (#116), Phi-4 Mini: 25.3 (#262)

Knowledge benchmarks
BenchmarkLongcat Flash ChatPhi-4 Mini
Vectara Hallucination Rate—23.5%
LMArena Expert1454—

Multilingual Not comparable

Longcat Flash Chat: 51.9 (#101), Phi-4 Mini: —

Multilingual benchmarks
BenchmarkLongcat Flash ChatPhi-4 Mini
LMArena Non-English1404—
LMArena Chinese1465—
LMArena French1456—
LMArena German1408—
LMArena Japanese1373—
LMArena Korean1371—
LMArena Russian1395—
LMArena Spanish1445—

Instruction Following Not comparable

Longcat Flash Chat: 74.4 (#96), Phi-4 Mini: —

Instruction Following benchmarks
BenchmarkLongcat Flash ChatPhi-4 Mini
LMArena Instruction Following1411—

Long Context Not comparable

Longcat Flash Chat: 43.5 (#93), Phi-4 Mini: —

Long Context benchmarks
BenchmarkLongcat Flash ChatPhi-4 Mini
LMArena Longer Query1425—

Writing & Preference Not comparable

Longcat Flash Chat: 61.0 (#91), Phi-4 Mini: —

Writing & Preference benchmarks
BenchmarkLongcat Flash ChatPhi-4 Mini
LMArena Text1427—
LMArena Creative Writing1388—
LMArena Multi-Turn1418—

Frequently asked questions

Is Longcat Flash Chat better than Phi-4 Mini?

Longcat Flash Chat is the stronger model overall, scoring 42.1 to 30.9 on the Noometry Index.

Is Longcat Flash Chat or Phi-4 Mini better for coding?

Longcat Flash Chat scores higher on coding benchmarks: 43.5 versus 28.1 in the Noometry coding category.

How many benchmarks do Longcat Flash Chat and Phi-4 Mini share?

0 benchmarks have published results for both models. Longcat Flash Chat has 19 scored results on Noometry and Phi-4 Mini has 3.

Related comparisons

Go deeper