Noometry

Model comparison

GPT-4.1 nano vs Grok-3 mini

Grok-3 mini is the stronger model overall, scoring 41.0 to 27.7 on the Noometry Index.

Last verified . 30 shared benchmarks.

GPT-4.1 nano OpenAI

27.7

Rank #322 Confirmed

Grok-3 mini xAI

41.0

Rank #130 Confirmed

Summary

  • They share 30 benchmarks with published results for both. GPT-4.1 nano scores higher in 0 categories and Grok-3 mini in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Grok-3 mini leads 46.3 to 21.8.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 28.9% for GPT-4.1 nano and 77.8% for Grok-3 mini.

Side by side

GPT-4.1 nanoGrok-3 mini
ProviderOpenAIxAI
Noometry Index27.741.0
Released2025-04-142025-04-09
WeightsProprietaryProprietary
Context window1.05M—
Max output33K—
Input $ / M tokens$0.10—
Output $ / M tokens$0.40—
Results tracked3835

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Grok-3 mini leads

GPT-4.1 nano: 23.8 (#325), Grok-3 mini: 40.4 (#126)

BenchmarkGPT-4.1 nanoGrok-3 mini
Aider Polyglot8.9%49.3%
WeirdML19%42.6%
LMArena Coding13061380
SciCode25.9%—

Agentic & Tool Use Not comparable

GPT-4.1 nano: 26.3 (#98), Grok-3 mini: —

BenchmarkGPT-4.1 nanoGrok-3 mini
Berkeley Function Calling Leaderboard33%—

Reasoning Grok-3 mini leads

GPT-4.1 nano: 8.6 (#344), Grok-3 mini: 13.8 (#323)

BenchmarkGPT-4.1 nanoGrok-3 mini
ARC-AGI-20%0.4%
Kagi LLM Benchmark33.3%61.3%
ARC-AGI-10%16.5%
LMArena Hard Prompts12861374
Epoch Capabilities Index129.62140.35
CritPt0%—
DTBench52.5%—
LMCA5.5%—

Math Grok-3 mini leads

GPT-4.1 nano: 25.5 (#246), Grok-3 mini: 40.3 (#78)

BenchmarkGPT-4.1 nanoGrok-3 mini
OTIS Mock AIME 2024-202528.9%77.8%
Omni-MATH36.7%31.8%
LMArena Math12741386
MATH Level 570%90.9%
FrontierMath (Feb 2025 set)1%5.9%

Knowledge Grok-3 mini leads

GPT-4.1 nano: 21.8 (#268), Grok-3 mini: 46.3 (#75)

BenchmarkGPT-4.1 nanoGrok-3 mini
GPQA Diamond48.9%76.3%
MMLU-Pro55%79.9%
GPQA (HELM)50.7%67.5%
LMArena Expert12721395
SimpleQA Verified6%—
Confabulations—10.8%

Multimodal Not comparable

GPT-4.1 nano: 28.6 (#108), Grok-3 mini: —

BenchmarkGPT-4.1 nanoGrok-3 mini
LMArena Vision1063—

Multilingual Grok-3 mini leads

GPT-4.1 nano: 41.8 (#200), Grok-3 mini: 48.3 (#141)

BenchmarkGPT-4.1 nanoGrok-3 mini
LMArena Non-English12601352
LMArena Chinese12701387
LMArena German12881350
LMArena Japanese11991343
LMArena Russian12611352
LMArena French—1357
LMArena Korean—1336
LMArena Spanish—1379

Instruction Following Grok-3 mini leads

GPT-4.1 nano: 68.0 (#188), Grok-3 mini: 78.7 (#8)

BenchmarkGPT-4.1 nanoGrok-3 mini
IFEval84.3%95.1%
LMArena Instruction Following12671356

Long Context Grok-3 mini leads

GPT-4.1 nano: 23.7 (#291), Grok-3 mini: 41.0 (#142)

BenchmarkGPT-4.1 nanoGrok-3 mini
Fiction.LiveBench25%66.7%
LMArena Longer Query12831372

Writing & Preference Grok-3 mini leads

GPT-4.1 nano: 40.7 (#238), Grok-3 mini: 52.7 (#163)

BenchmarkGPT-4.1 nanoGrok-3 mini
LMArena Text12851370
LMArena Creative Writing12601342
WildBench81.2%65.1%
LMArena Multi-Turn12771355
Short-Story Creative Writing—73.5%
EQ-Bench Creative Writing946—

Frequently asked questions

Is GPT-4.1 nano better than Grok-3 mini?

Grok-3 mini is the stronger model overall, scoring 41.0 to 27.7 on the Noometry Index.

Is GPT-4.1 nano or Grok-3 mini better for coding?

Grok-3 mini scores higher on coding benchmarks: 40.4 versus 23.8 in the Noometry coding category.

How many benchmarks do GPT-4.1 nano and Grok-3 mini share?

30 benchmarks have published results for both models. GPT-4.1 nano has 38 scored results on Noometry and Grok-3 mini has 35.

Related comparisons

Go deeper