Noometry

Model comparison

Llama 3.2 90B vs Longcat Flash Chat

Longcat Flash Chat is the stronger model overall, scoring 42.1 to 27.5 on the Noometry Index.

Last verified . 0 shared benchmarks.

Llama 3.2 90B Meta

27.5

Rank #331 Confirmed

Longcat Flash Chat Meituan

42.1

Rank #120 Confirmed

Summary

  • The widest gap is in math, where Longcat Flash Chat leads 39.4 to 11.1.

Side by side

Llama 3.2 90BLongcat Flash Chat
ProviderMetaMeituan
Noometry Index27.542.1
Released2024-09-24—
WeightsOpenOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked919

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Llama 3.2 90B: —, Longcat Flash Chat: 43.5 (#87)

BenchmarkLlama 3.2 90BLongcat Flash Chat
LMArena Coding—1471

Agentic & Tool Use Not comparable

Llama 3.2 90B: 30.0 (#80), Longcat Flash Chat: —

BenchmarkLlama 3.2 90BLongcat Flash Chat
BALROG27.3%—

Reasoning Llama 3.2 90B leads

Llama 3.2 90B: 21.7 (#217), Longcat Flash Chat: 19.0 (#272)

BenchmarkLlama 3.2 90BLongcat Flash Chat
Kagi LLM Benchmark—43.9%
NYT Connections (extended)—17.7%
EnigmaEval0.4%—
LMArena Hard Prompts—1440
Epoch Capabilities Index125.5—

Math Longcat Flash Chat leads

Llama 3.2 90B: 11.1 (#308), Longcat Flash Chat: 39.4 (#107)

BenchmarkLlama 3.2 90BLongcat Flash Chat
OTIS Mock AIME 2024-20252.6%—
LMArena Math—1442
MATH Level 539.4%—

Knowledge Longcat Flash Chat leads

Llama 3.2 90B: 21.7 (#274), Longcat Flash Chat: 40.6 (#116)

BenchmarkLlama 3.2 90BLongcat Flash Chat
GPQA Diamond41%—
LMArena Expert—1454
MMLU80.3%—

Multimodal Not comparable

Llama 3.2 90B: 25.4 (#124), Longcat Flash Chat: —

BenchmarkLlama 3.2 90BLongcat Flash Chat
LMArena Vision1000—
GeoBench52%—

Multilingual Not comparable

Llama 3.2 90B: —, Longcat Flash Chat: 51.9 (#101)

BenchmarkLlama 3.2 90BLongcat Flash Chat
LMArena Non-English—1404
LMArena Chinese—1465
LMArena French—1456
LMArena German—1408
LMArena Japanese—1373
LMArena Korean—1371
LMArena Russian—1395
LMArena Spanish—1445

Instruction Following Not comparable

Llama 3.2 90B: —, Longcat Flash Chat: 74.4 (#96)

BenchmarkLlama 3.2 90BLongcat Flash Chat
LMArena Instruction Following—1411

Long Context Not comparable

Llama 3.2 90B: —, Longcat Flash Chat: 43.5 (#93)

BenchmarkLlama 3.2 90BLongcat Flash Chat
LMArena Longer Query—1425

Writing & Preference Not comparable

Llama 3.2 90B: —, Longcat Flash Chat: 61.0 (#91)

BenchmarkLlama 3.2 90BLongcat Flash Chat
LMArena Text—1427
LMArena Creative Writing—1388
LMArena Multi-Turn—1418

Frequently asked questions

Is Llama 3.2 90B better than Longcat Flash Chat?

Longcat Flash Chat is the stronger model overall, scoring 42.1 to 27.5 on the Noometry Index.

How many benchmarks do Llama 3.2 90B and Longcat Flash Chat share?

0 benchmarks have published results for both models. Llama 3.2 90B has 9 scored results on Noometry and Longcat Flash Chat has 19.

Related comparisons

Go deeper