Model comparison

Longcat Flash Chat vs Ministral 3B

Longcat Flash Chat is the stronger model overall, scoring 42.1 to 26.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Longcat Flash Chat Meituan

42.1

Rank #120 Confirmed

Ministral 3B Mistral AI

26.2

Rank #338 Confirmed

Summary

  • The widest gap is in knowledge, where Longcat Flash Chat leads 40.6 to 10.4.

Side by side

Longcat Flash Chat and Ministral 3B specifications
Longcat Flash ChatMinistral 3B
ProviderMeituanMistral AI
Noometry Index42.126.2
Released—2024-10-01
WeightsOpenOpen
Context window—131K
Max output—262K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.10
Results tracked196

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Longcat Flash Chat: 43.5 (#87), Ministral 3B: —

Coding benchmarks
BenchmarkLongcat Flash ChatMinistral 3B
LMArena Coding1471—

Reasoning Too close to call

Longcat Flash Chat: 19.0 (#272), Ministral 3B: 18.4 (#282)

Reasoning benchmarks
BenchmarkLongcat Flash ChatMinistral 3B
Kagi LLM Benchmark43.9%—
NYT Connections (extended)17.7%—
LMArena Hard Prompts1440—
DTBench—51.7%
LMCA—5.5%
Epoch Capabilities Index—118.1

Math Longcat Flash Chat leads

Longcat Flash Chat: 39.4 (#107), Ministral 3B: 26.6 (#258)

Math benchmarks
BenchmarkLongcat Flash ChatMinistral 3B
LMArena Math1442—
MATH Level 5—14.4%

Knowledge Longcat Flash Chat leads

Longcat Flash Chat: 40.6 (#116), Ministral 3B: 10.4 (#302)

Knowledge benchmarks
BenchmarkLongcat Flash ChatMinistral 3B
GPQA Diamond—25.3%
Vectara Hallucination Rate—7.3%
LMArena Expert1454—

Multilingual Not comparable

Longcat Flash Chat: 51.9 (#101), Ministral 3B: —

Multilingual benchmarks
BenchmarkLongcat Flash ChatMinistral 3B
LMArena Non-English1404—
LMArena Chinese1465—
LMArena French1456—
LMArena German1408—
LMArena Japanese1373—
LMArena Korean1371—
LMArena Russian1395—
LMArena Spanish1445—

Instruction Following Not comparable

Longcat Flash Chat: 74.4 (#96), Ministral 3B: —

Instruction Following benchmarks
BenchmarkLongcat Flash ChatMinistral 3B
LMArena Instruction Following1411—

Long Context Not comparable

Longcat Flash Chat: 43.5 (#93), Ministral 3B: —

Long Context benchmarks
BenchmarkLongcat Flash ChatMinistral 3B
LMArena Longer Query1425—

Writing & Preference Not comparable

Longcat Flash Chat: 61.0 (#91), Ministral 3B: —

Writing & Preference benchmarks
BenchmarkLongcat Flash ChatMinistral 3B
LMArena Text1427—
LMArena Creative Writing1388—
LMArena Multi-Turn1418—

Frequently asked questions

Is Longcat Flash Chat better than Ministral 3B?

Longcat Flash Chat is the stronger model overall, scoring 42.1 to 26.2 on the Noometry Index.

How many benchmarks do Longcat Flash Chat and Ministral 3B share?

0 benchmarks have published results for both models. Longcat Flash Chat has 19 scored results on Noometry and Ministral 3B has 6.

Related comparisons

Go deeper