Model comparison

Falcon-180B vs Trinity Large Thinking

Trinity Large Thinking is the stronger model overall, scoring 38.1 to 31.8 on the Noometry Index.

Last verified . 6 shared benchmarks.

Trinity Large Thinking Arcee AI

38.1

Rank #180 Confirmed

Summary

  • They share 6 benchmarks with published results for both. Falcon-180B scores higher in 1 category and Trinity Large Thinking in 3 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Trinity Large Thinking leads 54.0 to 29.3.

Side by side

Falcon-180B and Trinity Large Thinking specifications
Falcon-180BTrinity Large Thinking
ProviderTechnology Innovation InstituteArcee AI
Noometry Index31.838.1
Released2023-09-062026-04-01
WeightsOpenOpen
Context window—262K
Max output—80K
Input $ / M tokens—$0.25
Output $ / M tokens—$0.80
Results tracked1624

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-180B: —, Trinity Large Thinking: 33.8 (#238)

Coding benchmarks
BenchmarkFalcon-180BTrinity Large Thinking
LMArena WebDev—1238
SciCode—36.1%
LMArena Coding—1381

Reasoning Falcon-180B leads

Falcon-180B: 18.3 (#266), Trinity Large Thinking: 16.3 (#298)

Reasoning benchmarks
BenchmarkFalcon-180BTrinity Large Thinking
LMArena Hard Prompts10071350
NYT Connections (extended)—16.5%
CritPt—0.9%
Thematic Generalization—41.6%
Surface Evolver Bench—15.6%
Epoch Capabilities Index111.89—
HellaSwag89%—
LAMBADA79.8%—
PIQA84.9%—
WinoGrande87.1%—

Math Not comparable

Falcon-180B: —, Trinity Large Thinking: 34.9 (#149)

Math benchmarks
BenchmarkFalcon-180BTrinity Large Thinking
LMArena Math—1366
GSM8K54.4%—

Knowledge Not comparable

Falcon-180B: —, Trinity Large Thinking: 40.3 (#107)

Knowledge benchmarks
BenchmarkFalcon-180BTrinity Large Thinking
Vectara Hallucination Rate—6.9%
LMArena Expert—1359
ARC (AI2) Challenge67.8%—
BoolQ89%—
MMLU70.6%—
OpenBookQA64.2%—

Multilingual Trinity Large Thinking leads

Falcon-180B: 25.3 (#281), Trinity Large Thinking: 46.4 (#155)

Multilingual benchmarks
BenchmarkFalcon-180BTrinity Large Thinking
LMArena Non-English10001325
LMArena Chinese—1372
LMArena French—1374
LMArena German—1356
LMArena Japanese—1312
LMArena Korean—1304
LMArena Russian—1338
LMArena Spanish—1356

Instruction Following Trinity Large Thinking leads

Falcon-180B: 53.6 (#281), Trinity Large Thinking: 70.7 (#157)

Instruction Following benchmarks
BenchmarkFalcon-180BTrinity Large Thinking
LMArena Instruction Following10471334

Long Context Not comparable

Falcon-180B: —, Trinity Large Thinking: 41.2 (#139)

Long Context benchmarks
BenchmarkFalcon-180BTrinity Large Thinking
LMArena Longer Query—1355

Writing & Preference Trinity Large Thinking leads

Falcon-180B: 29.3 (#290), Trinity Large Thinking: 54.0 (#152)

Writing & Preference benchmarks
BenchmarkFalcon-180BTrinity Large Thinking
LMArena Text10541340
LMArena Creative Writing10891321
LMArena Multi-Turn10131342

Frequently asked questions

Is Falcon-180B better than Trinity Large Thinking?

Trinity Large Thinking is the stronger model overall, scoring 38.1 to 31.8 on the Noometry Index.

How many benchmarks do Falcon-180B and Trinity Large Thinking share?

6 benchmarks have published results for both models. Falcon-180B has 16 scored results on Noometry and Trinity Large Thinking has 24.

Related comparisons

Go deeper