Model comparison

GPT-5.6 Terra vs Grok 2 Mini 2024 08 13

GPT-5.6 Terra is the stronger model overall, scoring 59.2 to 37.7 on the Noometry Index.

Last verified . 17 shared benchmarks.

GPT-5.6 Terra OpenAI

59.2

Rank #17 Confirmed

Grok 2 Mini 2024 08 13 xAI

37.7

Rank #198 Confirmed

Summary

  • They share 17 benchmarks with published results for both. GPT-5.6 Terra scores higher in 8 categories and Grok 2 Mini 2024 08 13 in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.6 Terra leads 81.6 to 35.4.

Side by side

GPT-5.6 Terra and Grok 2 Mini 2024 08 13 specifications
GPT-5.6 TerraGrok 2 Mini 2024 08 13
ProviderOpenAIxAI
Noometry Index59.237.7
Released2026-07-092024-08-13
WeightsProprietaryProprietary
Context window1.05M—
Max output128K—
Input $ / M tokens$2—
Output $ / M tokens$12—
Results tracked5217

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.6 Terra leads

GPT-5.6 Terra: 57.7 (#19), Grok 2 Mini 2024 08 13: 37.0 (#199)

Coding benchmarks
BenchmarkGPT-5.6 TerraGrok 2 Mini 2024 08 13
LMArena Coding14841269
DeepSWE69.6%—
FrontierCode41.3%—
CursorBench41.3%—
LMArena WebDev1522—
SciCode55%—
WeirdML78.3%—
ALE-Bench1,951—

Agentic & Tool Use Not comparable

GPT-5.6 Terra: 40.1 (#25), Grok 2 Mini 2024 08 13: —

Agentic & Tool Use benchmarks
BenchmarkGPT-5.6 TerraGrok 2 Mini 2024 08 13
APEX-Agents58.2%—
BALROG53.2%—
GDP.pdf24.7%—
Vending-Bench 27,343—

Reasoning GPT-5.6 Terra leads

GPT-5.6 Terra: 60.7 (#21), Grok 2 Mini 2024 08 13: 24.8 (#159)

Reasoning benchmarks
BenchmarkGPT-5.6 TerraGrok 2 Mini 2024 08 13
LMArena Hard Prompts14681255
ARC-AGI-283.9%—
SimpleBench48.9%—
Kagi LLM Benchmark51.3%—
NYT Connections (extended)78.4%—
ARC-AGI-196.5%—
CritPt30%—
Chess Puzzles54%—
Mystery Game Puzzles35%—
DTBench93.3%—
LMCA55%—
Surface Evolver Bench83.8%—
Epoch Capabilities Index159.62—

Math GPT-5.6 Terra leads

GPT-5.6 Terra: 81.6 (#12), Grok 2 Mini 2024 08 13: 35.4 (#185)

Math benchmarks
BenchmarkGPT-5.6 TerraGrok 2 Mini 2024 08 13
LMArena Math14661265
FrontierMath (Tiers 1-3)86%—
FrontierMath Tier 470.7%—
OTIS Mock AIME 2024-202599.7%—
ProofBench74%—

Knowledge GPT-5.6 Terra leads

GPT-5.6 Terra: 61.2 (#30), Grok 2 Mini 2024 08 13: 33.9 (#200)

Knowledge benchmarks
BenchmarkGPT-5.6 TerraGrok 2 Mini 2024 08 13
LMArena Expert14921238
GPQA Diamond93.3%—
SimpleQA Verified43.2%—

Multimodal Not comparable

GPT-5.6 Terra: 47.3 (#11), Grok 2 Mini 2024 08 13: —

Multimodal benchmarks
BenchmarkGPT-5.6 TerraGrok 2 Mini 2024 08 13
LMArena Vision1271—
Blueprint-Bench 230.8%—
Furniture Assembly54.2%—
LMArena Document1472—

Multilingual GPT-5.6 Terra leads

GPT-5.6 Terra: 54.4 (#44), Grok 2 Mini 2024 08 13: 41.4 (#208)

Multilingual benchmarks
BenchmarkGPT-5.6 TerraGrok 2 Mini 2024 08 13
LMArena Non-English14391257
LMArena Chinese15131262
LMArena French14711286
LMArena German14601273
LMArena Japanese14571213
LMArena Korean14251195
LMArena Russian14501261
LMArena Spanish14481279

Instruction Following GPT-5.6 Terra leads

GPT-5.6 Terra: 76.4 (#40), Grok 2 Mini 2024 08 13: 65.5 (#220)

Instruction Following benchmarks
BenchmarkGPT-5.6 TerraGrok 2 Mini 2024 08 13
LMArena Instruction Following14541245

Long Context GPT-5.6 Terra leads

GPT-5.6 Terra: 44.4 (#68), Grok 2 Mini 2024 08 13: 38.4 (#196)

Long Context benchmarks
BenchmarkGPT-5.6 TerraGrok 2 Mini 2024 08 13
LMArena Longer Query14511266

Writing & Preference GPT-5.6 Terra leads

GPT-5.6 Terra: 70.2 (#23), Grok 2 Mini 2024 08 13: 47.3 (#211)

Writing & Preference benchmarks
BenchmarkGPT-5.6 TerraGrok 2 Mini 2024 08 13
LMArena Text14471281
LMArena Creative Writing14101242
LMArena Multi-Turn14491265
EQ-Bench Creative Writing1855—
EQ-Bench 41234—

Frequently asked questions

Is GPT-5.6 Terra better than Grok 2 Mini 2024 08 13?

GPT-5.6 Terra is the stronger model overall, scoring 59.2 to 37.7 on the Noometry Index.

Is GPT-5.6 Terra or Grok 2 Mini 2024 08 13 better for coding?

GPT-5.6 Terra scores higher on coding benchmarks: 57.7 versus 37.0 in the Noometry coding category.

How many benchmarks do GPT-5.6 Terra and Grok 2 Mini 2024 08 13 share?

17 benchmarks have published results for both models. GPT-5.6 Terra has 52 scored results on Noometry and Grok 2 Mini 2024 08 13 has 17.

Related comparisons

Go deeper