Model comparison

GPT-4o mini vs GPT-6 Astra

GPT-6 Astra is the stronger model overall, scoring 70.3 to 25.4 on the Noometry Index. GPT-4o mini costs 76× less per token, which makes it the better buy when GPT-6 Astra's lead doesn't matter for your workload.

Last verified . 28 shared benchmarks.

GPT-4o mini OpenAI

25.4

Rank #337 Confirmed

GPT-6 Astra OpenAI

70.3

Rank #1 Confirmed

Summary

  • They share 28 benchmarks with published results for both. GPT-4o mini scores higher in 0 categories and GPT-6 Astra in 10 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-6 Astra leads 93.4 to 9.9.
  • The biggest single-benchmark swing is ARC-AGI-2: 0% for GPT-4o mini and 95% for GPT-6 Astra.
  • GPT-4o mini is cheaper at $0.15 / $0.60 per million input/output tokens, against $10 / $50 for GPT-6 Astra.
  • GPT-6 Astra accepts more context: 1.05M tokens versus 128K.

Side by side

GPT-4o mini and GPT-6 Astra specifications
GPT-4o miniGPT-6 Astra
ProviderOpenAIOpenAI
Noometry Index25.470.3
Released2024-07-182026-09-03
WeightsProprietaryProprietary
Context window128K1.05M
Max output16K128K
Input $ / M tokens$0.15$10
Output $ / M tokens$0.60$50
Results tracked6051

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-6 Astra leads

GPT-4o mini: 21.6 (#330), GPT-6 Astra: 70.5 (#3)

Coding benchmarks
BenchmarkGPT-4o miniGPT-6 Astra
WeirdML11.8%93.6%
LMArena Coding12901488
DeepSWE—74.1%
FrontierCode—53.3%
Aider Polyglot3.6%—
LMArena WebDev—1792
FrontierSWE—65.5%
SciCode—56.5%
BigCodeBench Instruct46.1%—
LiveBench Coding43.1%—
MirrorCode—46.7%
BigCodeBench Complete57.4%—
ALE-Bench—2,951
HumanEval+83.5%—
MBPP+72.2%—

Agentic & Tool Use GPT-6 Astra leads

GPT-4o mini: 27.2 (#95), GPT-6 Astra: 52.3 (#3)

Agentic & Tool Use benchmarks
BenchmarkGPT-4o miniGPT-6 Astra
BALROG17.4%68.3%
APEX-Agents—64.7%
Remote Labor Index—20.8%
Vending-Bench 2—15,515

Reasoning GPT-6 Astra leads

GPT-4o mini: 8.7 (#343), GPT-6 Astra: 85.1 (#1)

Reasoning benchmarks
BenchmarkGPT-4o miniGPT-6 Astra
ARC-AGI-20%95%
Chess Puzzles0%72%
LMArena Hard Prompts12671464
Mystery Game Puzzles12%84%
DTBench54.4%97.3%
LMCA10.4%64.4%
Epoch Capabilities Index126.56166.6
SimpleBench10.7%—
Kagi LLM Benchmark28.8%—
NYT Connections (extended)—98.1%
ARC-AGI-1—98.5%
CritPt—31.7%
EBR-Bench—76.2%
LiveBench Reasoning32.8%—
LiveBench Data Analysis50%—
Bench to the Future 3—0.14
LiveBench41.3%—
PIQA88.7%—

Math GPT-6 Astra leads

GPT-4o mini: 9.9 (#307), GPT-6 Astra: 93.4 (#1)

Math benchmarks
BenchmarkGPT-4o miniGPT-6 Astra
FrontierMath (Tiers 1-3)0.7%93.7%
OTIS Mock AIME 2024-20256.9%100%
LMArena Math12671463
FrontierMath Tier 4—97.6%
ProofBench—99%
Omni-MATH28%—
LiveBench Math36.3%—
MATH Level 552.6%—
FrontierMath Erdős—2.9%
GSM8K91.3%—

Knowledge GPT-6 Astra leads

GPT-4o mini: 17.7 (#279), GPT-6 Astra: 75.3 (#1)

Knowledge benchmarks
BenchmarkGPT-4o miniGPT-6 Astra
GPQA Diamond37.7%95.8%
SimpleQA Verified8.3%75.6%
LMArena Expert12351486
Humanity's Last Exam—54.8%
MMLU-Pro60.3%—
Confabulations37.2%—
Vectara Hallucination Rate—8.7%
GPQA (HELM)36.8%—
BoolQ88.7%—
MMLU81.8%—

Multimodal GPT-6 Astra leads

GPT-4o mini: 25.3 (#117), GPT-6 Astra: 55.1 (#3)

Multimodal benchmarks
BenchmarkGPT-4o miniGPT-6 Astra
LMArena Vision10661280
Video-MME64.8%—
GeoBench64%—
VPCT34%—
Blueprint-Bench 2—49.7%
Furniture Assembly—80%
LMArena Document—1468

Multilingual GPT-6 Astra leads

GPT-4o mini: 42.2 (#194), GPT-6 Astra: 54.0 (#53)

Multilingual benchmarks
BenchmarkGPT-4o miniGPT-6 Astra
LMArena Non-English12661431
LMArena Chinese12641495
LMArena French12961467
LMArena Russian12751434
LMArena Spanish12761412
LMArena German1272—
LMArena Japanese1216—
LMArena Korean1195—

Instruction Following GPT-6 Astra leads

GPT-4o mini: 62.1 (#234), GPT-6 Astra: 76.6 (#37)

Instruction Following benchmarks
BenchmarkGPT-4o miniGPT-6 Astra
LMArena Instruction Following12591454
LiveBench Instruction Following56.8%—
IFEval78.2%—

Long Context GPT-6 Astra leads

GPT-4o mini: 39.1 (#181), GPT-6 Astra: 44.7 (#57)

Long Context benchmarks
BenchmarkGPT-4o miniGPT-6 Astra
LMArena Longer Query12891460

Writing & Preference GPT-6 Astra leads

GPT-4o mini: 39.7 (#243), GPT-6 Astra: 75.7 (#7)

Writing & Preference benchmarks
BenchmarkGPT-4o miniGPT-6 Astra
LMArena Text12861443
LMArena Creative Writing12681423
EQ-Bench Creative Writing8732173
LMArena Multi-Turn12851457
Short-Story Creative Writing67.2%—
WildBench79.1%—
LiveBench Language28.6%—

Frequently asked questions

Is GPT-4o mini better than GPT-6 Astra?

GPT-6 Astra is the stronger model overall, scoring 70.3 to 25.4 on the Noometry Index. GPT-4o mini costs 76× less per token, which makes it the better buy when GPT-6 Astra's lead doesn't matter for your workload.

Which is cheaper, GPT-4o mini or GPT-6 Astra?

GPT-4o mini is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; GPT-6 Astra lists at $10 and $50.

Is GPT-4o mini or GPT-6 Astra better for coding?

GPT-6 Astra scores higher on coding benchmarks: 70.5 versus 21.6 in the Noometry coding category.

Which has the bigger context window?

GPT-6 Astra does, with 1.05M tokens against 128K.

How many benchmarks do GPT-4o mini and GPT-6 Astra share?

28 benchmarks have published results for both models. GPT-4o mini has 60 scored results on Noometry and GPT-6 Astra has 51.

Related comparisons

Go deeper