Model comparison

Chatgpt 4o Latest 20250326 vs Gemma 3n E4b IT

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.8 to 37.3 on the Noometry Index.

Last verified . 18 shared benchmarks.

Chatgpt 4o Latest 20250326 OpenAI

43.8

Rank #82 Confirmed

Gemma 3n E4b IT Google

37.3

Rank #206 Confirmed

Summary

  • They share 18 benchmarks with published results for both. Chatgpt 4o Latest 20250326 scores higher in 8 categories and Gemma 3n E4b IT in 0 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Chatgpt 4o Latest 20250326 leads 33.8 to 19.9.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 75% for Chatgpt 4o Latest 20250326 and 31.5% for Gemma 3n E4b IT.
  • Gemma 3n E4b IT has downloadable open weights; the other is API-only.

Side by side

Chatgpt 4o Latest 20250326 and Gemma 3n E4b IT specifications
Chatgpt 4o Latest 20250326Gemma 3n E4b IT
ProviderOpenAIGoogle
Noometry Index43.837.3
Released——
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2118

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 41.6 (#122), Gemma 3n E4b IT: 37.0 (#198)

Coding benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemma 3n E4b IT
LMArena Coding14131268

Reasoning Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 33.8 (#71), Gemma 3n E4b IT: 19.9 (#247)

Reasoning benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemma 3n E4b IT
Kagi LLM Benchmark75%31.5%
LMArena Hard Prompts14241284

Math Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 38.6 (#134), Gemma 3n E4b IT: 35.1 (#188)

Math benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemma 3n E4b IT
LMArena Math14071251

Knowledge Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 39.2 (#137), Gemma 3n E4b IT: 34.2 (#198)

Knowledge benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemma 3n E4b IT
LMArena Expert14011246
Confabulations16.6%—

Multimodal Not comparable

Chatgpt 4o Latest 20250326: 39.6 (#58), Gemma 3n E4b IT: —

Multimodal benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemma 3n E4b IT
LMArena Vision1243—

Multilingual Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 52.9 (#76), Gemma 3n E4b IT: 43.4 (#183)

Multilingual benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemma 3n E4b IT
LMArena Non-English14191285
LMArena Chinese14571309
LMArena French14461330
LMArena German14231311
LMArena Japanese14051272
LMArena Korean13961259
LMArena Russian14291288
LMArena Spanish14341305

Instruction Following Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 74.0 (#107), Gemma 3n E4b IT: 66.1 (#210)

Instruction Following benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemma 3n E4b IT
LMArena Instruction Following14031255

Long Context Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 43.1 (#107), Gemma 3n E4b IT: 38.7 (#191)

Long Context benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemma 3n E4b IT
LMArena Longer Query14131276

Writing & Preference Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 62.6 (#72), Gemma 3n E4b IT: 50.1 (#186)

Writing & Preference benchmarks
BenchmarkChatgpt 4o Latest 20250326Gemma 3n E4b IT
LMArena Text14291306
LMArena Creative Writing14051287
LMArena Multi-Turn14541276
EQ-Bench Creative Writing1501—

Frequently asked questions

Is Chatgpt 4o Latest 20250326 better than Gemma 3n E4b IT?

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.8 to 37.3 on the Noometry Index.

Is Chatgpt 4o Latest 20250326 or Gemma 3n E4b IT better for coding?

Chatgpt 4o Latest 20250326 scores higher on coding benchmarks: 41.6 versus 37.0 in the Noometry coding category.

How many benchmarks do Chatgpt 4o Latest 20250326 and Gemma 3n E4b IT share?

18 benchmarks have published results for both models. Chatgpt 4o Latest 20250326 has 21 scored results on Noometry and Gemma 3n E4b IT has 18.

Related comparisons

Go deeper