Noometry

Model comparison

Falcon-40B vs Gemini 3.8 Flash

Gemini 3.8 Flash has enough public results to be ranked (#11); Falcon-40B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Falcon-40B Technology Innovation Institute

—

Unranked

Gemini 3.8 Flash Google

61.8

Rank #11 Confirmed

Summary

  • They share 1 benchmark with published results for both.
  • Falcon-40B has downloadable open weights; the other is API-only.

Side by side

Falcon-40BGemini 3.8 Flash
ProviderTechnology Innovation InstituteGoogle
Noometry Index—61.8
Released2023-03-152026-09-02
WeightsOpenProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$0.75
Output $ / M tokens—$3.75
Results tracked1250

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon-40B: —, Gemini 3.8 Flash: 59.2 (#15)

BenchmarkFalcon-40BGemini 3.8 Flash
DeepSWE—73.8%
FrontierCode—41.2%
CursorBench—39.6%
LMArena WebDev—1584
FrontierSWE—19.6%
SciCode—56.6%
WeirdML—84.8%
LMArena Coding—1510
ALE-Bench—1,270

Agentic & Tool Use Not comparable

Falcon-40B: —, Gemini 3.8 Flash: 41.8 (#21)

BenchmarkFalcon-40BGemini 3.8 Flash
APEX-Agents—64.3%
Remote Labor Index—5.8%
GDP.pdf—23.4%
Vending-Bench 2—5,094

Reasoning Not comparable

Falcon-40B: —, Gemini 3.8 Flash: 76.9 (#5)

BenchmarkFalcon-40BGemini 3.8 Flash
Epoch Capabilities Index104.45156.71
ARC-AGI-2—89.2%
NYT Connections (extended)—97.4%
ARC-AGI-1—98.5%
CritPt—18.3%
Chess Puzzles—61%
LMArena Hard Prompts—1508
Mystery Game Puzzles—47%
DTBench—95.7%
LMCA—52.9%
Surface Evolver Bench—76.9%
BIG-Bench Hard37.1%—
HellaSwag85.3%—
LAMBADA77.3%—
PIQA83%—
WinoGrande76.9%—

Math Not comparable

Falcon-40B: —, Gemini 3.8 Flash: 65.3 (#28)

BenchmarkFalcon-40BGemini 3.8 Flash
FrontierMath (Tiers 1-3)—68.4%
FrontierMath Tier 4—22%
OTIS Mock AIME 2024-2025—98.9%
ProofBench—48%
LMArena Math—1528
GSM8K33.8%—

Knowledge Not comparable

Falcon-40B: —, Gemini 3.8 Flash: 74.8 (#2)

BenchmarkFalcon-40BGemini 3.8 Flash
GPQA Diamond—95.4%
Humanity's Last Exam—44.5%
SimpleQA Verified—69.7%
LMArena Expert—1524
ARC (AI2) Challenge61.9%—
BoolQ83.1%—
MMLU56.9%—
OpenBookQA56.6%—
TriviaQA79.9%—

Multimodal Not comparable

Falcon-40B: —, Gemini 3.8 Flash: 40.7 (#45)

BenchmarkFalcon-40BGemini 3.8 Flash
LMArena Vision—1314
Blueprint-Bench 2—38.6%
Furniture Assembly—31.7%

Multilingual Not comparable

Falcon-40B: —, Gemini 3.8 Flash: 58.0 (#5)

BenchmarkFalcon-40BGemini 3.8 Flash
LMArena Non-English—1491
LMArena Chinese—1554
LMArena French—1498
LMArena German—1493
LMArena Japanese—1502
LMArena Korean—1459
LMArena Russian—1515
LMArena Spanish—1485

Instruction Following Not comparable

Falcon-40B: —, Gemini 3.8 Flash: 78.0 (#13)

BenchmarkFalcon-40BGemini 3.8 Flash
LMArena Instruction Following—1490

Long Context Not comparable

Falcon-40B: —, Gemini 3.8 Flash: 46.3 (#24)

BenchmarkFalcon-40BGemini 3.8 Flash
LMArena Longer Query—1508

Writing & Preference Not comparable

Falcon-40B: —, Gemini 3.8 Flash: 72.2 (#15)

BenchmarkFalcon-40BGemini 3.8 Flash
LMArena Text—1499
LMArena Creative Writing—1492
EQ-Bench Creative Writing—1748
LMArena Multi-Turn—1501

Frequently asked questions

Is Falcon-40B better than Gemini 3.8 Flash?

Gemini 3.8 Flash has enough public results to be ranked (#11); Falcon-40B does not yet, so treat this comparison as directional.

How many benchmarks do Falcon-40B and Gemini 3.8 Flash share?

1 benchmark has published results for both models. Falcon-40B has 12 scored results on Noometry and Gemini 3.8 Flash has 50.

Related comparisons

Go deeper