Noometry

Model comparison

GPT-4o mini vs GPT-5.6 Sol

GPT-5.6 Sol is the stronger model overall, scoring 65.0 to 25.5 on the Noometry Index. GPT-4o mini costs 30× less per token, which makes it the better buy when GPT-5.6 Sol's lead doesn't matter for your workload.

Last verified . 33 shared benchmarks.

GPT-4o mini OpenAI

25.5

Rank #343 Confirmed

GPT-5.6 Sol OpenAI

65.0

Rank #7 Confirmed

Summary

  • They share 33 benchmarks with published results for both. GPT-4o mini scores higher in 0 categories and GPT-5.6 Sol in 10 categories; 10 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-5.6 Sol leads 85.6 to 10.4.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 6.9% for GPT-4o mini and 100% for GPT-5.6 Sol.
  • GPT-4o mini is cheaper at $0.15 / $0.60 per million input/output tokens, against $4 / $20 for GPT-5.6 Sol.
  • GPT-5.6 Sol accepts more context: 1.05M tokens versus 128K.

Side by side

GPT-4o miniGPT-5.6 Sol
ProviderOpenAIOpenAI
Noometry Index25.565.0
Released2024-07-182026-07-09
WeightsProprietaryProprietary
Context window128K1.05M
Max output16K128K
Input $ / M tokens$0.15$4
Output $ / M tokens$0.60$20
Results tracked6065

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.6 Sol leads

GPT-4o mini: 22.0 (#335), GPT-5.6 Sol: 65.1 (#7)

BenchmarkGPT-4o miniGPT-5.6 Sol
WeirdML11.8%89.4%
LMArena Coding12901498
DeepSWE—72.7%
FrontierCode—47.5%
Aider Polyglot3.6%—
CursorBench—41.7%
LMArena WebDev—1618
FrontierSWE—32.2%
SciCode—57.1%
GSO—76.5%
BigCodeBench Instruct46.1%—
LiveBench Coding43.1%—
MirrorCode—20%
BigCodeBench Complete57.4%—
ALE-Bench—2,177
HumanEval+83.5%—
MBPP+72.2%—

Agentic & Tool Use GPT-5.6 Sol leads

GPT-4o mini: 27.5 (#101), GPT-5.6 Sol: 50.3 (#7)

BenchmarkGPT-4o miniGPT-5.6 Sol
BALROG17.4%60%
APEX-Agents—51.4%
OSWorld 2.0—27.3%
τ²-bench Banking—46.9%
PostTrainBench—36.2%
GBAEval—52.6%
GDP.pdf—30.7%
LMArena Search—1257
Vending-Bench 2—9,619

Reasoning GPT-5.6 Sol leads

GPT-4o mini: 8.7 (#347), GPT-5.6 Sol: 74.8 (#8)

BenchmarkGPT-4o miniGPT-5.6 Sol
ARC-AGI-20%92.5%
SimpleBench10.7%71.7%
Kagi LLM Benchmark28.8%67%
Chess Puzzles0%64%
LMArena Hard Prompts12671484
Mystery Game Puzzles12%58%
DTBench54.4%96%
LMCA10.4%59.2%
Epoch Capabilities Index126.56161.66
NYT Connections (extended)—93.8%
ARC-AGI-1—97.5%
CritPt—32.3%
EnigmaEval—37.1%
EBR-Bench—44.8%
LiveBench Reasoning32.8%—
LiveBench Data Analysis50%—
Surface Evolver Bench—93.1%
Bench to the Future 3—0.14
LiveBench41.3%—
PIQA88.7%—

Math GPT-5.6 Sol leads

GPT-4o mini: 10.4 (#314), GPT-5.6 Sol: 85.6 (#9)

BenchmarkGPT-4o miniGPT-5.6 Sol
FrontierMath (Tiers 1-3)0.7%89.1%
OTIS Mock AIME 2024-20256.9%100%
LMArena Math12671474
FrontierMath Tier 4—82.9%
ProofBench—83%
Omni-MATH28%—
LiveBench Math36.3%—
MATH Level 552.6%—
FrontierMath Erdős—0%
GSM8K91.3%—

Knowledge GPT-5.6 Sol leads

GPT-4o mini: 17.7 (#284), GPT-5.6 Sol: 64.3 (#18)

BenchmarkGPT-4o miniGPT-5.6 Sol
GPQA Diamond37.7%93.5%
SimpleQA Verified8.3%69.7%
LMArena Expert12351516
MMLU-Pro60.3%—
Confabulations37.2%—
Vectara Hallucination Rate—12.4%
GPQA (HELM)36.8%—
BoolQ88.7%—
MMLU81.8%—

Multimodal GPT-5.6 Sol leads

GPT-4o mini: 25.9 (#122), GPT-5.6 Sol: 48.6 (#9)

BenchmarkGPT-4o miniGPT-5.6 Sol
LMArena Vision10661281
Video-MME64.8%—
GeoBench64%—
VPCT34%—
Blueprint-Bench 2—33.6%
Furniture Assembly—56.7%
LMArena Document—1483

Multilingual GPT-5.6 Sol leads

GPT-4o mini: 42.0 (#199), GPT-5.6 Sol: 55.3 (#32)

BenchmarkGPT-4o miniGPT-5.6 Sol
LMArena Non-English12661452
LMArena Chinese12651527
LMArena French12971477
LMArena German12721476
LMArena Japanese12161471
LMArena Korean11951442
LMArena Russian12751468
LMArena Spanish12761441

Instruction Following GPT-5.6 Sol leads

GPT-4o mini: 61.9 (#239), GPT-5.6 Sol: 77.7 (#16)

BenchmarkGPT-4o miniGPT-5.6 Sol
LMArena Instruction Following12581482
LiveBench Instruction Following56.8%—
IFEval78.2%—

Long Context GPT-5.6 Sol leads

GPT-4o mini: 39.1 (#186), GPT-5.6 Sol: 45.4 (#42)

BenchmarkGPT-4o miniGPT-5.6 Sol
LMArena Longer Query12891480

Writing & Preference GPT-5.6 Sol leads

GPT-4o mini: 39.5 (#248), GPT-5.6 Sol: 73.3 (#12)

BenchmarkGPT-4o miniGPT-5.6 Sol
LMArena Text12861457
LMArena Creative Writing12681448
EQ-Bench Creative Writing8731972
LMArena Multi-Turn12851460
Short-Story Creative Writing67.2%—
WildBench79.1%—
EQ-Bench 4—1250
LiveBench Language28.6%—

Frequently asked questions

Is GPT-4o mini better than GPT-5.6 Sol?

GPT-5.6 Sol is the stronger model overall, scoring 65.0 to 25.5 on the Noometry Index. GPT-4o mini costs 30× less per token, which makes it the better buy when GPT-5.6 Sol's lead doesn't matter for your workload.

Which is cheaper, GPT-4o mini or GPT-5.6 Sol?

GPT-4o mini is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; GPT-5.6 Sol lists at $4 and $20.

Is GPT-4o mini or GPT-5.6 Sol better for coding?

GPT-5.6 Sol scores higher on coding benchmarks: 65.1 versus 22.0 in the Noometry coding category.

Which has the bigger context window?

GPT-5.6 Sol does, with 1.05M tokens against 128K.

How many benchmarks do GPT-4o mini and GPT-5.6 Sol share?

33 benchmarks have published results for both models. GPT-4o mini has 60 scored results on Noometry and GPT-5.6 Sol has 65.

Related comparisons

Go deeper