Noometry

Model comparison

Grok 4.3 vs Llama 3.1-405B

Grok 4.3 is the stronger model overall, scoring 43.6 to 30.4 on the Noometry Index.

Last verified . 23 shared benchmarks.

Grok 4.3 xAI

43.6

Rank #80 Confirmed

Llama 3.1-405B Meta

30.4

Rank #279 Confirmed

Summary

  • They share 23 benchmarks with published results for both. Grok 4.3 scores higher in 9 categories and Llama 3.1-405B in 0 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in math, where Grok 4.3 leads 45.8 to 17.3.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 93.3% for Grok 4.3 and 9.7% for Llama 3.1-405B.
  • Llama 3.1-405B has downloadable open weights; the other is API-only.

Side by side

Grok 4.3Llama 3.1-405B
ProviderxAIMeta
Noometry Index43.630.4
Released2026-04-172024-07-23
WeightsProprietaryOpen
Context window1M—
Max output30K—
Input $ / M tokens$1.25—
Output $ / M tokens$2.50—
Results tracked4042

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok 4.3 leads

Grok 4.3: 41.3 (#117), Llama 3.1-405B: 32.7 (#257)

BenchmarkGrok 4.3Llama 3.1-405B
WeirdML49.9%21.4%
LMArena Coding14151291
LMArena WebDev1357—
SciCode47.3%—
ALE-Bench944.17—

Agentic & Tool Use Grok 4.3 leads

Grok 4.3: 27.6 (#93), Llama 3.1-405B: 20.9 (#131)

BenchmarkGrok 4.3Llama 3.1-405B
TheAgentCompany—7.4%
Cybench—7.5%
GDP.pdf8%—
LMArena Search1165—
Vending-Bench 235.26—

Reasoning Grok 4.3 leads

Grok 4.3: 34.9 (#60), Llama 3.1-405B: 16.4 (#293)

BenchmarkGrok 4.3Llama 3.1-405B
LMArena Hard Prompts13971270
DTBench90.7%61.4%
Epoch Capabilities Index149.13128.76
ForecastBench60.359.9
SimpleBench—23%
Kagi LLM Benchmark—45%
NYT Connections (extended)55.2%—
CritPt8%—
Chess Puzzles25%—
LMCA38.3%—
BIG-Bench Hard—82.9%
HellaSwag—89.2%
PIQA—85.9%
WinoGrande—89.2%

Math Grok 4.3 leads

Grok 4.3: 45.8 (#60), Llama 3.1-405B: 17.3 (#283)

BenchmarkGrok 4.3Llama 3.1-405B
OTIS Mock AIME 2024-202593.3%9.7%
LMArena Math13881281
FrontierMath (Tiers 1-3)42.8%—
FrontierMath Tier 414.6%—
ProofBench11%—
Omni-MATH—24.9%
MATH Level 5—49.8%

Knowledge Grok 4.3 leads

Grok 4.3: 52.5 (#57), Llama 3.1-405B: 30.4 (#221)

BenchmarkGrok 4.3Llama 3.1-405B
GPQA Diamond88.8%50.9%
LMArena Expert13851243
SimpleQA Verified33.2%—
MMLU-Pro—72.3%
Confabulations—17.6%
GPQA (HELM)—52.2%
ARC (AI2) Challenge—95.3%
MMLU—84.5%
TriviaQA—82.7%

Multimodal Not comparable

Grok 4.3: 31.6 (#96), Llama 3.1-405B: —

BenchmarkGrok 4.3Llama 3.1-405B
LMArena Vision1231—
Blueprint-Bench 20%—

Multilingual Grok 4.3 leads

Grok 4.3: 50.7 (#114), Llama 3.1-405B: 40.9 (#209)

BenchmarkGrok 4.3Llama 3.1-405B
LMArena Non-English13851248
LMArena Chinese14231242
LMArena French14121278
LMArena German13951252
LMArena Japanese13791208
LMArena Korean13571184
LMArena Russian13991265
LMArena Spanish14021259

Instruction Following Grok 4.3 leads

Grok 4.3: 72.3 (#135), Llama 3.1-405B: 66.1 (#209)

BenchmarkGrok 4.3Llama 3.1-405B
LMArena Instruction Following13661259
IFEval—81.1%

Long Context Grok 4.3 leads

Grok 4.3: 42.5 (#118), Llama 3.1-405B: 38.4 (#192)

BenchmarkGrok 4.3Llama 3.1-405B
LMArena Longer Query13931266

Writing & Preference Grok 4.3 leads

Grok 4.3: 58.6 (#112), Llama 3.1-405B: 39.1 (#246)

BenchmarkGrok 4.3Llama 3.1-405B
LMArena Text13971284
LMArena Creative Writing13801262
LMArena Multi-Turn14061297
EQ-Bench Creative Writing—870
WildBench—78.3%
EQ-Bench 41075—

Frequently asked questions

Is Grok 4.3 better than Llama 3.1-405B?

Grok 4.3 is the stronger model overall, scoring 43.6 to 30.4 on the Noometry Index.

Is Grok 4.3 or Llama 3.1-405B better for coding?

Grok 4.3 scores higher on coding benchmarks: 41.3 versus 32.7 in the Noometry coding category.

How many benchmarks do Grok 4.3 and Llama 3.1-405B share?

23 benchmarks have published results for both models. Grok 4.3 has 40 scored results on Noometry and Llama 3.1-405B has 42.

Related comparisons

Go deeper