Noometry

Model comparison

Falcon 2 11B vs Gemini 1.5 Flash 8B

Gemini 1.5 Flash 8B has enough public results to be ranked (#292); Falcon 2 11B does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Falcon 2 11B Technology Innovation Institute

—

Unranked

Gemini 1.5 Flash 8B Google

29.7

Rank #292 Confirmed

Summary

  • Falcon 2 11B has downloadable open weights; the other is API-only.

Side by side

Falcon 2 11BGemini 1.5 Flash 8B
ProviderTechnology Innovation InstituteGoogle
Noometry Index—29.7
Released2024-05-092024-10-03
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked521

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon 2 11B: —, Gemini 1.5 Flash 8B: 34.9 (#221)

BenchmarkFalcon 2 11BGemini 1.5 Flash 8B
LMArena Coding—1218

Reasoning Not comparable

Falcon 2 11B: —, Gemini 1.5 Flash 8B: 19.2 (#242)

BenchmarkFalcon 2 11BGemini 1.5 Flash 8B
LMArena Hard Prompts—1210
DTBench—50%
Epoch Capabilities Index109.25—
HellaSwag82.9%—
WinoGrande78.3%—

Math Not comparable

Falcon 2 11B: —, Gemini 1.5 Flash 8B: 13.3 (#296)

BenchmarkFalcon 2 11BGemini 1.5 Flash 8B
OTIS Mock AIME 2024-2025—4.6%
LMArena Math—1207
GSM8K53.8%—

Knowledge Not comparable

Falcon 2 11B: —, Gemini 1.5 Flash 8B: 16.0 (#285)

BenchmarkFalcon 2 11BGemini 1.5 Flash 8B
GPQA Diamond—33%
LMArena Expert—1185
MMLU58.4%—

Multimodal Not comparable

Falcon 2 11B: —, Gemini 1.5 Flash 8B: 27.6 (#110)

BenchmarkFalcon 2 11BGemini 1.5 Flash 8B
LMArena Vision—1044

Multilingual Not comparable

Falcon 2 11B: —, Gemini 1.5 Flash 8B: 38.6 (#224)

BenchmarkFalcon 2 11BGemini 1.5 Flash 8B
LMArena Non-English—1215
LMArena Chinese—1231
LMArena French—1233
LMArena German—1206
LMArena Japanese—1150
LMArena Korean—1140
LMArena Russian—1236
LMArena Spanish—1212

Instruction Following Not comparable

Falcon 2 11B: —, Gemini 1.5 Flash 8B: 63.1 (#231)

BenchmarkFalcon 2 11BGemini 1.5 Flash 8B
LMArena Instruction Following—1199

Long Context Not comparable

Falcon 2 11B: —, Gemini 1.5 Flash 8B: 36.9 (#220)

BenchmarkFalcon 2 11BGemini 1.5 Flash 8B
LMArena Longer Query—1219

Writing & Preference Not comparable

Falcon 2 11B: —, Gemini 1.5 Flash 8B: 43.0 (#227)

BenchmarkFalcon 2 11BGemini 1.5 Flash 8B
LMArena Text—1226
LMArena Creative Writing—1218
LMArena Multi-Turn—1185

Frequently asked questions

Is Falcon 2 11B better than Gemini 1.5 Flash 8B?

Gemini 1.5 Flash 8B has enough public results to be ranked (#292); Falcon 2 11B does not yet, so treat this comparison as directional.

How many benchmarks do Falcon 2 11B and Gemini 1.5 Flash 8B share?

0 benchmarks have published results for both models. Falcon 2 11B has 5 scored results on Noometry and Gemini 1.5 Flash 8B has 21.

Related comparisons

Go deeper