Model comparison

Chatgpt 4o Latest 20250326 vs Inkling

Chatgpt 4o Latest 20250326 and Inkling score almost the same on the Noometry Index (43.8 vs 44.1), so choose on price, context window or the category you care about most.

Last verified . 18 shared benchmarks.

Chatgpt 4o Latest 20250326 OpenAI

43.8

Rank #82 Confirmed

Inkling Thinking Machines Lab

44.1

Rank #80 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Chatgpt 4o Latest 20250326 scores higher in 2 categories and Inkling in 6 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Inkling leads 55.1 to 39.2.
  • Inkling has downloadable open weights; the other is API-only.

Side by side

Chatgpt 4o Latest 20250326 and Inkling specifications
Chatgpt 4o Latest 20250326Inkling
ProviderOpenAIThinking Machines Lab
Noometry Index43.844.1
Released—2026-07-15
WeightsProprietaryOpen
Context window—66K
Max output—66K
Input $ / M tokens—$1.87
Output $ / M tokens—$4.68
Results tracked2141

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 41.6 (#122), Inkling: 34.5 (#234)

Coding benchmarks
BenchmarkChatgpt 4o Latest 20250326Inkling
LMArena Coding14131464
FrontierCode—14%
LMArena WebDev—1413
FrontierSWE—4.1%
SciCode—47%
WeirdML—32.3%
ALE-Bench—946

Agentic & Tool Use Not comparable

Chatgpt 4o Latest 20250326: —, Inkling: 29.6 (#85)

Agentic & Tool Use benchmarks
BenchmarkChatgpt 4o Latest 20250326Inkling
APEX-Agents—33.8%
τ²-bench Banking—25%

Reasoning Inkling leads

Chatgpt 4o Latest 20250326: 33.8 (#71), Inkling: 40.4 (#56)

Reasoning benchmarks
BenchmarkChatgpt 4o Latest 20250326Inkling
LMArena Hard Prompts14241451
ARC-AGI-2—36.5%
SimpleBench—50%
Kagi LLM Benchmark75%—
ARC-AGI-1—79.5%
CritPt—5.4%
Chess Puzzles—21%
DTBench—87.5%
LMCA—37.6%
Epoch Capabilities Index—148.54

Math Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 38.6 (#134), Inkling: 31.3 (#225)

Math benchmarks
BenchmarkChatgpt 4o Latest 20250326Inkling
LMArena Math14071479
FrontierMath (Tiers 1-3)—33.3%
FrontierMath Tier 4—4.9%
OTIS Mock AIME 2024-2025—88.9%
ProofBench—0%

Knowledge Inkling leads

Chatgpt 4o Latest 20250326: 39.2 (#137), Inkling: 55.1 (#49)

Knowledge benchmarks
BenchmarkChatgpt 4o Latest 20250326Inkling
LMArena Expert14011465
GPQA Diamond—88.3%
SimpleQA Verified—40.3%
Confabulations16.6%—

Multimodal Not comparable

Chatgpt 4o Latest 20250326: 39.6 (#58), Inkling: —

Multimodal benchmarks
BenchmarkChatgpt 4o Latest 20250326Inkling
LMArena Vision1243—

Multilingual Inkling leads

Chatgpt 4o Latest 20250326: 52.9 (#76), Inkling: 54.0 (#52)

Multilingual benchmarks
BenchmarkChatgpt 4o Latest 20250326Inkling
LMArena Non-English14191434
LMArena Chinese14571490
LMArena French14461458
LMArena German14231446
LMArena Japanese14051429
LMArena Korean13961404
LMArena Russian14291429
LMArena Spanish14341448

Instruction Following Inkling leads

Chatgpt 4o Latest 20250326: 74.0 (#107), Inkling: 75.1 (#71)

Instruction Following benchmarks
BenchmarkChatgpt 4o Latest 20250326Inkling
LMArena Instruction Following14031426

Long Context Too close to call

Chatgpt 4o Latest 20250326: 43.1 (#107), Inkling: 43.8 (#86)

Long Context benchmarks
BenchmarkChatgpt 4o Latest 20250326Inkling
LMArena Longer Query14131434

Writing & Preference Inkling leads

Chatgpt 4o Latest 20250326: 62.6 (#72), Inkling: 65.2 (#51)

Writing & Preference benchmarks
BenchmarkChatgpt 4o Latest 20250326Inkling
LMArena Text14291441
LMArena Creative Writing14051387
EQ-Bench Creative Writing15011611
LMArena Multi-Turn14541436
EQ-Bench 4—1226

Frequently asked questions

Is Chatgpt 4o Latest 20250326 better than Inkling?

Chatgpt 4o Latest 20250326 and Inkling score almost the same on the Noometry Index (43.8 vs 44.1), so choose on price, context window or the category you care about most.

Is Chatgpt 4o Latest 20250326 or Inkling better for coding?

Chatgpt 4o Latest 20250326 scores higher on coding benchmarks: 41.6 versus 34.5 in the Noometry coding category.

How many benchmarks do Chatgpt 4o Latest 20250326 and Inkling share?

18 benchmarks have published results for both models. Chatgpt 4o Latest 20250326 has 21 scored results on Noometry and Inkling has 41.

Related comparisons

Go deeper