Noometry

Model comparison

Gemma 3 1B vs Grok 4.1

Grok 4.1 is the stronger model overall, scoring 41.5 to 21.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 3 1B Google

21.1

Rank #353 Reported

Grok 4.1 xAI

41.5

Rank #134 Confirmed

Summary

  • The widest gap is in knowledge, where Grok 4.1 leads 39.5 to 7.0.
  • Gemma 3 1B has downloadable open weights; the other is API-only.

Side by side

Gemma 3 1BGrok 4.1
ProviderGooglexAI
Noometry Index21.141.5
Released2025-03-122025-11-17
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked419

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Grok 4.1: 33.7 (#253)

BenchmarkGemma 3 1BGrok 4.1
LMArena WebDev—1214
LMArena Coding—1445

Agentic & Tool Use Grok 4.1 leads

Gemma 3 1B: 13.7 (#152), Grok 4.1: 34.1 (#49)

BenchmarkGemma 3 1BGrok 4.1
Berkeley Function Calling Leaderboard7.2%—
Cybench—39%

Reasoning Grok 4.1 leads

Gemma 3 1B: 19.2 (#264), Grok 4.1: 29.5 (#91)

BenchmarkGemma 3 1BGrok 4.1
Chess Puzzles0%—
LMArena Hard Prompts—1435

Math Grok 4.1 leads

Gemma 3 1B: 10.2 (#316), Grok 4.1: 38.9 (#120)

BenchmarkGemma 3 1BGrok 4.1
OTIS Mock AIME 2024-20251.1%—
LMArena Math—1422

Knowledge Grok 4.1 leads

Gemma 3 1B: 7.0 (#314), Grok 4.1: 39.5 (#133)

BenchmarkGemma 3 1BGrok 4.1
GPQA Diamond19.9%—
LMArena Expert—1417

Multilingual Not comparable

Gemma 3 1B: —, Grok 4.1: 53.4 (#68)

BenchmarkGemma 3 1BGrok 4.1
LMArena Non-English—1425
LMArena Chinese—1465
LMArena French—1448
LMArena German—1446
LMArena Japanese—1397
LMArena Korean—1407
LMArena Russian—1434
LMArena Spanish—1438

Instruction Following Not comparable

Gemma 3 1B: —, Grok 4.1: 73.8 (#111)

BenchmarkGemma 3 1BGrok 4.1
LMArena Instruction Following—1400

Long Context Not comparable

Gemma 3 1B: —, Grok 4.1: 43.2 (#100)

BenchmarkGemma 3 1BGrok 4.1
LMArena Longer Query—1416

Writing & Preference Not comparable

Gemma 3 1B: —, Grok 4.1: 62.4 (#75)

BenchmarkGemma 3 1BGrok 4.1
LMArena Text—1437
LMArena Creative Writing—1411
LMArena Multi-Turn—1437

Frequently asked questions

Is Gemma 3 1B better than Grok 4.1?

Grok 4.1 is the stronger model overall, scoring 41.5 to 21.1 on the Noometry Index.

How many benchmarks do Gemma 3 1B and Grok 4.1 share?

0 benchmarks have published results for both models. Gemma 3 1B has 4 scored results on Noometry and Grok 4.1 has 19.

Related comparisons

Go deeper