Model comparison

Falcon 2 11B vs Llama 4 Maverick

Llama 4 Maverick has enough public results to be ranked (#276); Falcon 2 11B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Summary

  • They share 1 benchmark with published results for both.

Side by side

Falcon 2 11B and Llama 4 Maverick specifications
Falcon 2 11BLlama 4 Maverick
ProviderTechnology Innovation InstituteMeta
Noometry Index—30.6
Released2024-05-092025-04-05
WeightsOpenOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.19
Output $ / M tokens—$0.65
Results tracked554

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon 2 11B: —, Llama 4 Maverick: 26.3 (#318)

Coding benchmarks
BenchmarkFalcon 2 11BLlama 4 Maverick
SWE-bench Verified (bash only)—21%
Aider Polyglot—15.6%
SciCode—33.1%
WeirdML—24.5%
BigCodeBench Instruct—49.7%
LMArena Coding—1302
BigCodeBench Complete—61.4%
ALE-Bench—172.97

Agentic & Tool Use Not comparable

Falcon 2 11B: —, Llama 4 Maverick: 27.9 (#86)

Agentic & Tool Use benchmarks
BenchmarkFalcon 2 11BLlama 4 Maverick
Berkeley Function Calling Leaderboard—37.3%

Reasoning Not comparable

Falcon 2 11B: —, Llama 4 Maverick: 10.1 (#337)

Reasoning benchmarks
BenchmarkFalcon 2 11BLlama 4 Maverick
Epoch Capabilities Index109.25132.2
ARC-AGI-2—0%
SimpleBench—27.7%
Kagi LLM Benchmark—55.9%
NYT Connections (extended)—8%
ARC-AGI-1—4.4%
CritPt—0%
EnigmaEval—0.6%
LMArena Hard Prompts—1281
DTBench—61.9%
LMCA—15.9%
ForecastBench—57.5
HellaSwag82.9%—
WinoGrande78.3%—

Math Not comparable

Falcon 2 11B: —, Llama 4 Maverick: 24.6 (#256)

Math benchmarks
BenchmarkFalcon 2 11BLlama 4 Maverick
OTIS Mock AIME 2024-2025—20.6%
Omni-MATH—42.2%
LMArena Math—1299
MATH Level 5—73%
FrontierMath (Feb 2025 set)—0.7%
GSM8K53.8%—

Knowledge Not comparable

Falcon 2 11B: —, Llama 4 Maverick: 33.3 (#196)

Knowledge benchmarks
BenchmarkFalcon 2 11BLlama 4 Maverick
GPQA Diamond—67%
Humanity's Last Exam—5.7%
MMLU-Pro—81%
Confabulations—22.6%
Vectara Hallucination Rate—8.2%
GPQA (HELM)—65%
LMArena Expert—1259
MMLU58.4%—

Multimodal Not comparable

Falcon 2 11B: —, Llama 4 Maverick: 30.9 (#100)

Multimodal benchmarks
BenchmarkFalcon 2 11BLlama 4 Maverick
LMArena Vision—1141
GeoBench—52%
SpatialViz-Bench—31.8%

Multilingual Not comparable

Falcon 2 11B: —, Llama 4 Maverick: 42.4 (#190)

Multilingual benchmarks
BenchmarkFalcon 2 11BLlama 4 Maverick
LMArena Non-English—1269
LMArena Chinese—1277
LMArena French—1258
LMArena German—1291
LMArena Japanese—1207
LMArena Korean—1203
LMArena Russian—1286
LMArena Spanish—1293

Instruction Following Not comparable

Falcon 2 11B: —, Llama 4 Maverick: 71.9 (#140)

Instruction Following benchmarks
BenchmarkFalcon 2 11BLlama 4 Maverick
IFEval—90.8%
LMArena Instruction Following—1267

Long Context Not comparable

Falcon 2 11B: —, Llama 4 Maverick: 31.4 (#274)

Long Context benchmarks
BenchmarkFalcon 2 11BLlama 4 Maverick
Fiction.LiveBench—46.2%
LMArena Longer Query—1280

Writing & Preference Not comparable

Falcon 2 11B: —, Llama 4 Maverick: 39.0 (#247)

Writing & Preference benchmarks
BenchmarkFalcon 2 11BLlama 4 Maverick
LMArena Text—1287
LMArena Creative Writing—1266
Short-Story Creative Writing—62%
EQ-Bench Creative Writing—860
WildBench—80%
LMArena Multi-Turn—1289

Frequently asked questions

Is Falcon 2 11B better than Llama 4 Maverick?

Llama 4 Maverick has enough public results to be ranked (#276); Falcon 2 11B does not yet, so treat this comparison as directional.

How many benchmarks do Falcon 2 11B and Llama 4 Maverick share?

1 benchmark has published results for both models. Falcon 2 11B has 5 scored results on Noometry and Llama 4 Maverick has 54.

Related comparisons

Go deeper