Model comparison

Falcon 2 11B vs Grok 4.20 (Non-Reasoning)

Grok 4.20 (Non-Reasoning) has enough public results to be ranked (#54); Falcon 2 11B does not yet, so treat this comparison as directional.

Last verified . 1 shared benchmarks.

Summary

  • They share 1 benchmark with published results for both.
  • Falcon 2 11B has downloadable open weights; the other is API-only.

Side by side

Falcon 2 11B and Grok 4.20 (Non-Reasoning) specifications
Falcon 2 11BGrok 4.20 (Non-Reasoning)
ProviderTechnology Innovation InstitutexAI
Noometry Index—48.6
Released2024-05-092026-02-17
WeightsOpenProprietary
Context window—1M
Max output—30K
Input $ / M tokens—$1.25
Output $ / M tokens—$2.50
Results tracked546

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Falcon 2 11B: —, Grok 4.20 (Non-Reasoning): 42.1 (#112)

Coding benchmarks
BenchmarkFalcon 2 11BGrok 4.20 (Non-Reasoning)
LMArena WebDev—1375
WeirdML—52.3%
LMArena Coding—1459
ALE-Bench—1,150

Agentic & Tool Use Not comparable

Falcon 2 11B: —, Grok 4.20 (Non-Reasoning): 34.4 (#46)

Agentic & Tool Use benchmarks
BenchmarkFalcon 2 11BGrok 4.20 (Non-Reasoning)
Terminal-Bench—57.3%
τ²-bench Banking—18%
LMArena Search—1189
Vending-Bench 2—4,663

Reasoning Not comparable

Falcon 2 11B: —, Grok 4.20 (Non-Reasoning): 52.3 (#32)

Reasoning benchmarks
BenchmarkFalcon 2 11BGrok 4.20 (Non-Reasoning)
Epoch Capabilities Index109.56151.98
ARC-AGI-2—65.1%
Kagi LLM Benchmark—75%
NYT Connections (extended)—85.4%
ARC-AGI-1—89.5%
Chess Puzzles—24%
Thematic Generalization—63.8%
LMArena Hard Prompts—1451
DTBench—90.1%
LMCA—38.7%
ForecastBench—61.4
HellaSwag82.9%—
WinoGrande78.3%—

Math Not comparable

Falcon 2 11B: —, Grok 4.20 (Non-Reasoning): 48.2 (#65)

Math benchmarks
BenchmarkFalcon 2 11BGrok 4.20 (Non-Reasoning)
FrontierMath (Tiers 1-3)—44.9%
FrontierMath Tier 4—17.1%
OTIS Mock AIME 2024-2025—92.2%
ProofBench—14%
LMArena Math—1455
GSM8K53.8%—

Knowledge Not comparable

Falcon 2 11B: —, Grok 4.20 (Non-Reasoning): 52.8 (#60)

Knowledge benchmarks
BenchmarkFalcon 2 11BGrok 4.20 (Non-Reasoning)
GPQA Diamond—89.3%
SimpleQA Verified—30.2%
LMArena Expert—1439
MMLU58.4%—

Multimodal Not comparable

Falcon 2 11B: —, Grok 4.20 (Non-Reasoning): 33.3 (#98)

Multimodal benchmarks
BenchmarkFalcon 2 11BGrok 4.20 (Non-Reasoning)
LMArena Vision—1263
Blueprint-Bench 2—0%
LMArena Document—1416

Multilingual Not comparable

Falcon 2 11B: —, Grok 4.20 (Non-Reasoning): 54.5 (#40)

Multilingual benchmarks
BenchmarkFalcon 2 11BGrok 4.20 (Non-Reasoning)
LMArena Non-English—1441
LMArena Chinese—1481
LMArena French—1476
LMArena German—1465
LMArena Japanese—1449
LMArena Korean—1417
LMArena Russian—1458
LMArena Spanish—1443

Instruction Following Not comparable

Falcon 2 11B: —, Grok 4.20 (Non-Reasoning): 74.8 (#83)

Instruction Following benchmarks
BenchmarkFalcon 2 11BGrok 4.20 (Non-Reasoning)
LMArena Instruction Following—1420

Long Context Not comparable

Falcon 2 11B: —, Grok 4.20 (Non-Reasoning): 45.5 (#34)

Long Context benchmarks
BenchmarkFalcon 2 11BGrok 4.20 (Non-Reasoning)
CL-bench—22.2%
CL-bench Life—11.9%
LMArena Longer Query—1437

Writing & Preference Not comparable

Falcon 2 11B: —, Grok 4.20 (Non-Reasoning): 65.7 (#44)

Writing & Preference benchmarks
BenchmarkFalcon 2 11BGrok 4.20 (Non-Reasoning)
LMArena Text—1451
LMArena Creative Writing—1438
EQ-Bench Creative Writing—1574
LMArena Multi-Turn—1456

Frequently asked questions

Is Falcon 2 11B better than Grok 4.20 (Non-Reasoning)?

Grok 4.20 (Non-Reasoning) has enough public results to be ranked (#54); Falcon 2 11B does not yet, so treat this comparison as directional.

How many benchmarks do Falcon 2 11B and Grok 4.20 (Non-Reasoning) share?

1 benchmark has published results for both models. Falcon 2 11B has 5 scored results on Noometry and Grok 4.20 (Non-Reasoning) has 46.

Related comparisons

Go deeper