Model comparison

Chatgpt 4o Latest 20250326 vs Gemini 3.8 Flash

Gemini 3.8 Flash is the stronger model overall, scoring 61.8 to 43.8 on the Noometry Index.

Last verified . 19 shared benchmarks.

Chatgpt 4o Latest 20250326 OpenAI

43.8

Rank #82 Confirmed

Gemini 3.8 Flash Google

61.8

Rank #11 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Chatgpt 4o Latest 20250326 scores higher in 0 categories and Gemini 3.8 Flash in 9 categories; 9 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Gemini 3.8 Flash leads 76.9 to 33.8.

Side by side

Chatgpt 4o Latest 20250326 and Gemini 3.8 Flash specifications
Chatgpt 4o Latest 20250326Gemini 3.8 Flash
ProviderOpenAIGoogle
Noometry Index43.861.8
Released—2026-09-02
WeightsProprietaryProprietary
Context window—1.05M
Max output—66K
Input $ / M tokens—$0.75
Output $ / M tokens—$3.75
Results tracked2150

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 3.8 Flash leads

Chatgpt 4o Latest 20250326: 41.6 (#122), Gemini 3.8 Flash: 59.2 (#15)

Coding benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemini 3.8 Flash
LMArena Coding14131510
DeepSWE—73.8%
FrontierCode—41.2%
CursorBench—39.6%
LMArena WebDev—1584
FrontierSWE—19.6%
SciCode—56.6%
WeirdML—84.8%
ALE-Bench—1,270

Agentic & Tool Use Not comparable

Chatgpt 4o Latest 20250326: —, Gemini 3.8 Flash: 41.8 (#21)

Agentic & Tool Use benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemini 3.8 Flash
APEX-Agents—64.3%
Remote Labor Index—5.8%
GDP.pdf—23.4%
Vending-Bench 2—5,094

Reasoning Gemini 3.8 Flash leads

Chatgpt 4o Latest 20250326: 33.8 (#71), Gemini 3.8 Flash: 76.9 (#5)

Reasoning benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemini 3.8 Flash
LMArena Hard Prompts14241508
ARC-AGI-2—89.2%
Kagi LLM Benchmark75%—
NYT Connections (extended)—97.4%
ARC-AGI-1—98.5%
CritPt—18.3%
Chess Puzzles—61%
Mystery Game Puzzles—47%
DTBench—95.7%
LMCA—52.9%
Surface Evolver Bench—76.9%
Epoch Capabilities Index—156.71

Math Gemini 3.8 Flash leads

Chatgpt 4o Latest 20250326: 38.6 (#134), Gemini 3.8 Flash: 65.3 (#28)

Math benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemini 3.8 Flash
LMArena Math14071528
FrontierMath (Tiers 1-3)—68.4%
FrontierMath Tier 4—22%
OTIS Mock AIME 2024-2025—98.9%
ProofBench—48%

Knowledge Gemini 3.8 Flash leads

Chatgpt 4o Latest 20250326: 39.2 (#137), Gemini 3.8 Flash: 74.8 (#2)

Knowledge benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemini 3.8 Flash
LMArena Expert14011524
GPQA Diamond—95.4%
Humanity's Last Exam—44.5%
SimpleQA Verified—69.7%
Confabulations16.6%—

Multimodal Gemini 3.8 Flash leads

Chatgpt 4o Latest 20250326: 39.6 (#58), Gemini 3.8 Flash: 40.7 (#45)

Multimodal benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemini 3.8 Flash
LMArena Vision12431314
Blueprint-Bench 2—38.6%
Furniture Assembly—31.7%

Multilingual Gemini 3.8 Flash leads

Chatgpt 4o Latest 20250326: 52.9 (#76), Gemini 3.8 Flash: 58.0 (#5)

Multilingual benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemini 3.8 Flash
LMArena Non-English14191491
LMArena Chinese14571554
LMArena French14461498
LMArena German14231493
LMArena Japanese14051502
LMArena Korean13961459
LMArena Russian14291515
LMArena Spanish14341485

Instruction Following Gemini 3.8 Flash leads

Chatgpt 4o Latest 20250326: 74.0 (#107), Gemini 3.8 Flash: 78.0 (#13)

Instruction Following benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemini 3.8 Flash
LMArena Instruction Following14031490

Long Context Gemini 3.8 Flash leads

Chatgpt 4o Latest 20250326: 43.1 (#107), Gemini 3.8 Flash: 46.3 (#24)

Long Context benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemini 3.8 Flash
LMArena Longer Query14131508

Writing & Preference Gemini 3.8 Flash leads

Chatgpt 4o Latest 20250326: 62.6 (#72), Gemini 3.8 Flash: 72.2 (#15)

Writing & Preference benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemini 3.8 Flash
LMArena Text14291499
LMArena Creative Writing14051492
EQ-Bench Creative Writing15011748
LMArena Multi-Turn14541501

Frequently asked questions

Is Chatgpt 4o Latest 20250326 better than Gemini 3.8 Flash?

Gemini 3.8 Flash is the stronger model overall, scoring 61.8 to 43.8 on the Noometry Index.

Is Chatgpt 4o Latest 20250326 or Gemini 3.8 Flash better for coding?

Gemini 3.8 Flash scores higher on coding benchmarks: 59.2 versus 41.6 in the Noometry coding category.

How many benchmarks do Chatgpt 4o Latest 20250326 and Gemini 3.8 Flash share?

19 benchmarks have published results for both models. Chatgpt 4o Latest 20250326 has 21 scored results on Noometry and Gemini 3.8 Flash has 50.

Related comparisons

Go deeper