Noometry

Model comparison

Gemma 2B vs Grok 4.7

Grok 4.7 is the stronger model overall, scoring 53.1 to 29.6 on the Noometry Index.

Last verified . 12 shared benchmarks.

Gemma 2B Google

29.6

Rank #307 Confirmed

Grok 4.7 xAI

53.1

Rank #37 Confirmed

Summary

  • They share 12 benchmarks with published results for both. Gemma 2B scores higher in 0 categories and Grok 4.7 in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Grok 4.7 leads 70.0 to 24.0.
  • Gemma 2B has downloadable open weights; the other is API-only.

Side by side

Gemma 2BGrok 4.7
ProviderGooglexAI
Noometry Index29.653.1
Released2024-02-212026-09-21
WeightsOpenProprietary
Context window—500K
Max output—500K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked2339

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.7 leads

Gemma 2B: 29.4 (#305), Grok 4.7: 58.0 (#18)

BenchmarkGemma 2BGrok 4.7
LMArena Coding10101427
FrontierCode—47.6%
CursorBench—46.3%
LMArena WebDev—1639
FrontierSWE—29.5%
SciCode—57.8%
HumanEval+20.7%—
MBPP+34.1%—

Agentic & Tool Use Not comparable

Gemma 2B: —, Grok 4.7: 36.7 (#37)

BenchmarkGemma 2BGrok 4.7
APEX-Agents—54.6%
GDP.pdf—22.8%
Vending-Bench 2—10,537

Reasoning Grok 4.7 leads

Gemma 2B: 18.8 (#275), Grok 4.7: 49.1 (#40)

BenchmarkGemma 2BGrok 4.7
LMArena Hard Prompts9891413
Epoch Capabilities Index94.2153.53
NYT Connections (extended)—76.8%
CritPt—18%
Chess Puzzles—38%
Mystery Game Puzzles—29%
DTBench—96%
LMCA—49.4%
BIG-Bench Hard35.2%—
HellaSwag71.4%—
PIQA77.3%—
WinoGrande65.4%—

Math Grok 4.7 leads

Gemma 2B: 30.0 (#239), Grok 4.7: 57.8 (#39)

BenchmarkGemma 2BGrok 4.7
LMArena Math10091407
FrontierMath (Tiers 1-3)—53%
FrontierMath Tier 4—17.1%
OTIS Mock AIME 2024-2025—98.1%
ProofBench—34%
GSM8K17.7%—

Knowledge Not comparable

Gemma 2B: —, Grok 4.7: 62.8 (#22)

BenchmarkGemma 2BGrok 4.7
GPQA Diamond—92.7%
SimpleQA Verified—56%
LMArena Expert—1422
ARC (AI2) Challenge42.1%—
BoolQ69.4%—
MMLU42.3%—
TriviaQA53.2%—

Multimodal Not comparable

Gemma 2B: —, Grok 4.7: 35.5 (#87)

BenchmarkGemma 2BGrok 4.7
LMArena Vision—1228
Blueprint-Bench 2—32.5%
Furniture Assembly—20.8%

Multilingual Grok 4.7 leads

Gemma 2B: 23.0 (#294), Grok 4.7: 50.8 (#116)

BenchmarkGemma 2BGrok 4.7
LMArena Non-English9581389
LMArena Chinese9861455
LMArena Russian9371397
LMArena French—1455
LMArena Spanish—1400

Instruction Following Grok 4.7 leads

Gemma 2B: 48.5 (#302), Grok 4.7: 74.1 (#105)

BenchmarkGemma 2BGrok 4.7
LMArena Instruction Following9701404

Long Context Grok 4.7 leads

Gemma 2B: 29.9 (#291), Grok 4.7: 43.1 (#104)

BenchmarkGemma 2BGrok 4.7
LMArena Longer Query9811413

Writing & Preference Grok 4.7 leads

Gemma 2B: 24.0 (#308), Grok 4.7: 70.0 (#24)

BenchmarkGemma 2BGrok 4.7
LMArena Text10021399
LMArena Creative Writing9871391
LMArena Multi-Turn9451393
EQ-Bench Creative Writing—2007

Frequently asked questions

Is Gemma 2B better than Grok 4.7?

Grok 4.7 is the stronger model overall, scoring 53.1 to 29.6 on the Noometry Index.

Is Gemma 2B or Grok 4.7 better for coding?

Grok 4.7 scores higher on coding benchmarks: 58.0 versus 29.4 in the Noometry coding category.

How many benchmarks do Gemma 2B and Grok 4.7 share?

12 benchmarks have published results for both models. Gemma 2B has 23 scored results on Noometry and Grok 4.7 has 39.

Related comparisons

Go deeper