Model comparison

Falcon-180B vs Inkling-Small

Inkling-Small is the stronger model overall, scoring 46.5 to 32.2 on the Noometry Index.

Last verified . 7 shared benchmarks.

Summary

  • They share 7 benchmarks with published results for both. Falcon-180B scores higher in 0 categories and Inkling-Small in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Inkling-Small leads 59.6 to 29.1.

Side by side

Falcon-180B and Inkling-Small specifications
Falcon-180BInkling-Small
ProviderTechnology Innovation InstituteThinking Machines Lab
Noometry Index32.246.5
Released2023-09-062026-07-15
WeightsOpenOpen
Context window—524K
Max output—1.05M
Input $ / M tokens—$0.45
Output $ / M tokens—$1.20
Results tracked1633

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-180B: —, Inkling-Small: 43.6 (#85)

Coding benchmarks
BenchmarkFalcon-180BInkling-Small
LMArena WebDev—1409
SciCode—48.7%
LMArena Coding—1451

Reasoning Inkling-Small leads

Falcon-180B: 19.1 (#269), Inkling-Small: 38.6 (#63)

Reasoning benchmarks
BenchmarkFalcon-180BInkling-Small
LMArena Hard Prompts10071423
Epoch Capabilities Index112.13150.15
ARC-AGI-2—40.1%
ARC-AGI-1—84%
CritPt—8.3%
Chess Puzzles—18%
Mystery Game Puzzles—6%
HellaSwag89%—
LAMBADA79.8%—
PIQA84.9%—
WinoGrande87.1%—

Math Not comparable

Falcon-180B: —, Inkling-Small: 45.1 (#77)

Math benchmarks
BenchmarkFalcon-180BInkling-Small
FrontierMath (Tiers 1-3)—46.3%
FrontierMath Tier 4—17.1%
OTIS Mock AIME 2024-2025—90%
ProofBench—6%
LMArena Math—1459
GSM8K54.4%—

Knowledge Not comparable

Falcon-180B: —, Inkling-Small: 48.2 (#77)

Knowledge benchmarks
BenchmarkFalcon-180BInkling-Small
GPQA Diamond—88.5%
SimpleQA Verified—19.1%
LMArena Expert—1442
ARC (AI2) Challenge67.8%—
BoolQ89%—
MMLU70.6%—
OpenBookQA64.2%—

Multimodal Not comparable

Falcon-180B: —, Inkling-Small: 39.1 (#62)

Multimodal benchmarks
BenchmarkFalcon-180BInkling-Small
LMArena Vision—1235

Multilingual Inkling-Small leads

Falcon-180B: 25.2 (#286), Inkling-Small: 51.7 (#104)

Multilingual benchmarks
BenchmarkFalcon-180BInkling-Small
LMArena Non-English10001402
LMArena Chinese—1465
LMArena French—1436
LMArena German—1405
LMArena Japanese—1405
LMArena Korean—1363
LMArena Russian—1391
LMArena Spanish—1428

Instruction Following Inkling-Small leads

Falcon-180B: 53.4 (#286), Inkling-Small: 73.8 (#114)

Instruction Following benchmarks
BenchmarkFalcon-180BInkling-Small
LMArena Instruction Following10471399

Long Context Not comparable

Falcon-180B: —, Inkling-Small: 42.7 (#118)

Long Context benchmarks
BenchmarkFalcon-180BInkling-Small
LMArena Longer Query—1401

Writing & Preference Inkling-Small leads

Falcon-180B: 29.1 (#295), Inkling-Small: 59.6 (#107)

Writing & Preference benchmarks
BenchmarkFalcon-180BInkling-Small
LMArena Text10541414
LMArena Creative Writing10891331
LMArena Multi-Turn10131418
EQ-Bench Creative Writing—1491

Frequently asked questions

Is Falcon-180B better than Inkling-Small?

Inkling-Small is the stronger model overall, scoring 46.5 to 32.2 on the Noometry Index.

How many benchmarks do Falcon-180B and Inkling-Small share?

7 benchmarks have published results for both models. Falcon-180B has 16 scored results on Noometry and Inkling-Small has 33.

Related comparisons

Go deeper