Model comparison

Falcon-180B vs Gemini 3.5 Flash

Gemini 3.5 Flash is the stronger model overall, scoring 54.2 to 32.2 on the Noometry Index.

Last verified . 7 shared benchmarks.

Gemini 3.5 Flash Google

54.2

Rank #32 Confirmed

Summary

  • They share 7 benchmarks with published results for both. Falcon-180B scores higher in 0 categories and Gemini 3.5 Flash in 4 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3.5 Flash leads 62.8 to 19.1.
  • Falcon-180B has downloadable open weights; the other is API-only.

Side by side

Falcon-180B and Gemini 3.5 Flash specifications
Falcon-180BGemini 3.5 Flash
ProviderTechnology Innovation InstituteGoogle
Noometry Index32.254.2
Released2023-09-062026-05-19
WeightsOpenProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$1.50
Output $ / M tokens—$9
Results tracked1654

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-180B: —, Gemini 3.5 Flash: 49.4 (#49)

Coding benchmarks
BenchmarkFalcon-180BGemini 3.5 Flash
SWE-bench Verified—79.3%
DeepSWE—37.4%
LMArena WebDev—1499
SciCode—53.1%
WeirdML—62.6%
LMArena Coding—1492
ALE-Bench—911.02

Agentic & Tool Use Not comparable

Falcon-180B: —, Gemini 3.5 Flash: 24.7 (#114)

Agentic & Tool Use benchmarks
BenchmarkFalcon-180BGemini 3.5 Flash
APEX-Agents—27.5%
GBAEval—6.7%
GDP.pdf—14%
Vending-Bench 2—5,396

Reasoning Gemini 3.5 Flash leads

Falcon-180B: 19.1 (#269), Gemini 3.5 Flash: 62.8 (#18)

Reasoning benchmarks
BenchmarkFalcon-180BGemini 3.5 Flash
LMArena Hard Prompts10071488
Epoch Capabilities Index112.13154.46
ARC-AGI-2—72.1%
SimpleBench—76.7%
NYT Connections (extended)—92.6%
ARC-AGI-1—92.5%
CritPt—13.1%
Chess Puzzles—50%
EnigmaEval—25.4%
EBR-Bench—4.8%
Mystery Game Puzzles—32%
DTBench—94.7%
LMCA—47.1%
Surface Evolver Bench—58.1%
ForecastBench—59
HellaSwag89%—
LAMBADA79.8%—
PIQA84.9%—
WinoGrande87.1%—

Math Not comparable

Falcon-180B: —, Gemini 3.5 Flash: 60.7 (#36)

Knowledge Not comparable

Falcon-180B: —, Gemini 3.5 Flash: 66.3 (#11)

Knowledge benchmarks
BenchmarkFalcon-180BGemini 3.5 Flash
GPQA Diamond—92.8%
SimpleQA Verified—66.2%
LMArena Expert—1495
ARC (AI2) Challenge67.8%—
BoolQ89%—
MMLU70.6%—
OpenBookQA64.2%—

Multimodal Not comparable

Falcon-180B: —, Gemini 3.5 Flash: 45.7 (#15)

Multimodal benchmarks
BenchmarkFalcon-180BGemini 3.5 Flash
LMArena Vision—1310
Blueprint-Bench 2—33.6%
LMArena Document—1463

Multilingual Gemini 3.5 Flash leads

Falcon-180B: 25.2 (#286), Gemini 3.5 Flash: 57.0 (#13)

Multilingual benchmarks
BenchmarkFalcon-180BGemini 3.5 Flash
LMArena Non-English10001476
LMArena Chinese—1526
LMArena French—1490
LMArena German—1492
LMArena Japanese—1486
LMArena Korean—1451
LMArena Russian—1493
LMArena Spanish—1480

Instruction Following Gemini 3.5 Flash leads

Falcon-180B: 53.4 (#286), Gemini 3.5 Flash: 77.0 (#30)

Instruction Following benchmarks
BenchmarkFalcon-180BGemini 3.5 Flash
LMArena Instruction Following10471467

Long Context Not comparable

Falcon-180B: —, Gemini 3.5 Flash: 45.4 (#38)

Long Context benchmarks
BenchmarkFalcon-180BGemini 3.5 Flash
LMArena Longer Query—1482

Writing & Preference Gemini 3.5 Flash leads

Falcon-180B: 29.1 (#295), Gemini 3.5 Flash: 65.5 (#47)

Writing & Preference benchmarks
BenchmarkFalcon-180BGemini 3.5 Flash
LMArena Text10541482
LMArena Creative Writing10891470
LMArena Multi-Turn10131481
EQ-Bench 4—1087

Frequently asked questions

Is Falcon-180B better than Gemini 3.5 Flash?

Gemini 3.5 Flash is the stronger model overall, scoring 54.2 to 32.2 on the Noometry Index.

How many benchmarks do Falcon-180B and Gemini 3.5 Flash share?

7 benchmarks have published results for both models. Falcon-180B has 16 scored results on Noometry and Gemini 3.5 Flash has 54.

Related comparisons

Go deeper