Noometry

Model comparison

Grok 4.1 vs Llama-3.3-70B-Instruct

Grok 4.1 is the stronger model overall, scoring 40.8 to 30.3 on the Noometry Index.

Last verified . 17 shared benchmarks.

Grok 4.1 xAI

40.8

Rank #135 Confirmed

Llama-3.3-70B-Instruct Meta

30.3

Rank #283 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Grok 4.1 scores higher in 9 categories and Llama-3.3-70B-Instruct in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Grok 4.1 leads 36.2 to 14.3.
  • Llama-3.3-70B-Instruct has downloadable open weights; the other is API-only.

Side by side

Grok 4.1Llama-3.3-70B-Instruct
ProviderxAIMeta
Noometry Index40.830.3
Released2025-11-172024-12-06
WeightsProprietaryOpen
Context window—128K
Max output—4K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.32
Results tracked1943

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.1 leads

Grok 4.1: 33.4 (#246), Llama-3.3-70B-Instruct: 30.6 (#284)

BenchmarkGrok 4.1Llama-3.3-70B-Instruct
LMArena Coding14451268
LMArena WebDev1214—
SciCode—26%
WeirdML—14.4%
BigCodeBench Instruct—46.9%
LiveBench Coding—36.6%
BigCodeBench Complete—57.5%

Agentic & Tool Use Grok 4.1 leads

Grok 4.1: 33.8 (#47), Llama-3.3-70B-Instruct: 25.6 (#100)

BenchmarkGrok 4.1Llama-3.3-70B-Instruct
Berkeley Function Calling Leaderboard—31.9%
Cybench39%—
BALROG—23%

Reasoning Grok 4.1 leads

Grok 4.1: 28.3 (#91), Llama-3.3-70B-Instruct: 13.7 (#325)

BenchmarkGrok 4.1Llama-3.3-70B-Instruct
LMArena Hard Prompts14361257
SimpleBench—19.9%
CritPt—0%
LiveBench Reasoning—50.8%
DTBench—59.5%
LiveBench Data Analysis—49.5%
LMCA—17.5%
Epoch Capabilities Index—127.32
ForecastBench—58.6
LiveBench—50.2%

Math Grok 4.1 leads

Grok 4.1: 36.2 (#124), Llama-3.3-70B-Instruct: 14.3 (#292)

BenchmarkGrok 4.1Llama-3.3-70B-Instruct
LMArena Math14221268
OTIS Mock AIME 2024-2025—5.1%
LiveBench Math—42.2%
MATH Level 5—41.6%

Knowledge Grok 4.1 leads

Grok 4.1: 38.9 (#129), Llama-3.3-70B-Instruct: 30.5 (#220)

BenchmarkGrok 4.1Llama-3.3-70B-Instruct
LMArena Expert14171225
GPQA Diamond—47.4%
Confabulations—22.8%
Vectara Hallucination Rate—4.1%
MMLU—86.3%

Multilingual Grok 4.1 leads

Grok 4.1: 53.6 (#64), Llama-3.3-70B-Instruct: 40.1 (#215)

BenchmarkGrok 4.1Llama-3.3-70B-Instruct
LMArena Non-English14251236
LMArena Chinese14641217
LMArena French14481280
LMArena German14471251
LMArena Japanese13961149
LMArena Korean14071142
LMArena Russian14341252
LMArena Spanish14381269

Instruction Following Grok 4.1 leads

Grok 4.1: 74.0 (#106), Llama-3.3-70B-Instruct: 71.3 (#152)

BenchmarkGrok 4.1Llama-3.3-70B-Instruct
LMArena Instruction Following14001242
LiveBench Instruction Following—82.7%

Long Context Grok 4.1 leads

Grok 4.1: 43.2 (#96), Llama-3.3-70B-Instruct: 26.4 (#290)

BenchmarkGrok 4.1Llama-3.3-70B-Instruct
LMArena Longer Query14161256
Fiction.LiveBench—33.3%

Writing & Preference Grok 4.1 leads

Grok 4.1: 62.6 (#71), Llama-3.3-70B-Instruct: 47.8 (#203)

BenchmarkGrok 4.1Llama-3.3-70B-Instruct
LMArena Text14371274
LMArena Creative Writing14111250
LMArena Multi-Turn14381279
LiveBench Language—39.2%

Frequently asked questions

Is Grok 4.1 better than Llama-3.3-70B-Instruct?

Grok 4.1 is the stronger model overall, scoring 40.8 to 30.3 on the Noometry Index.

Is Grok 4.1 or Llama-3.3-70B-Instruct better for coding?

Grok 4.1 scores higher on coding benchmarks: 33.4 versus 30.6 in the Noometry coding category.

How many benchmarks do Grok 4.1 and Llama-3.3-70B-Instruct share?

17 benchmarks have published results for both models. Grok 4.1 has 19 scored results on Noometry and Llama-3.3-70B-Instruct has 43.

Related comparisons

Go deeper