Model comparison

Chatgpt 4o Latest 20250326 vs Mistral Small 3.2

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.8 to 31.2 on the Noometry Index.

Last verified . 2 shared benchmarks.

Chatgpt 4o Latest 20250326 OpenAI

43.8

Rank #82 Confirmed

Mistral Small 3.2 Mistral AI

31.2

Rank #280 Confirmed

Summary

  • They share 2 benchmarks with published results for both. Chatgpt 4o Latest 20250326 scores higher in 4 categories and Mistral Small 3.2 in 0 categories; 4 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Chatgpt 4o Latest 20250326 leads 62.6 to 45.0.
  • The biggest single-benchmark swing is Kagi LLM Benchmark: 75% for Chatgpt 4o Latest 20250326 and 40.4% for Mistral Small 3.2.
  • Mistral Small 3.2 has downloadable open weights; the other is API-only.

Side by side

Chatgpt 4o Latest 20250326 and Mistral Small 3.2 specifications
Chatgpt 4o Latest 20250326Mistral Small 3.2
ProviderOpenAIMistral AI
Noometry Index43.831.2
Released—2025-06-20
WeightsProprietaryOpen
Context window—256K
Max output—16K
Input $ / M tokens—$0.0938
Output $ / M tokens—$0.25
Results tracked216

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Chatgpt 4o Latest 20250326: 41.6 (#122), Mistral Small 3.2: —

Coding benchmarks
BenchmarkChatgpt 4o Latest 20250326Mistral Small 3.2
LMArena Coding1413—

Reasoning Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 33.8 (#71), Mistral Small 3.2: 18.1 (#287)

Reasoning benchmarks
BenchmarkChatgpt 4o Latest 20250326Mistral Small 3.2
Kagi LLM Benchmark75%40.4%
Chess Puzzles—1%
LMArena Hard Prompts1424—
Epoch Capabilities Index—131.74

Math Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 38.6 (#134), Mistral Small 3.2: 26.3 (#260)

Math benchmarks
BenchmarkChatgpt 4o Latest 20250326Mistral Small 3.2
OTIS Mock AIME 2024-2025—30.3%
LMArena Math1407—

Knowledge Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 39.2 (#137), Mistral Small 3.2: 26.7 (#256)

Knowledge benchmarks
BenchmarkChatgpt 4o Latest 20250326Mistral Small 3.2
GPQA Diamond—49.1%
Confabulations16.6%—
LMArena Expert1401—

Multimodal Not comparable

Chatgpt 4o Latest 20250326: 39.6 (#58), Mistral Small 3.2: —

Multimodal benchmarks
BenchmarkChatgpt 4o Latest 20250326Mistral Small 3.2
LMArena Vision1243—

Multilingual Not comparable

Chatgpt 4o Latest 20250326: 52.9 (#76), Mistral Small 3.2: —

Multilingual benchmarks
BenchmarkChatgpt 4o Latest 20250326Mistral Small 3.2
LMArena Non-English1419—
LMArena Chinese1457—
LMArena French1446—
LMArena German1423—
LMArena Japanese1405—
LMArena Korean1396—
LMArena Russian1429—
LMArena Spanish1434—

Instruction Following Not comparable

Chatgpt 4o Latest 20250326: 74.0 (#107), Mistral Small 3.2: —

Instruction Following benchmarks
BenchmarkChatgpt 4o Latest 20250326Mistral Small 3.2
LMArena Instruction Following1403—

Long Context Not comparable

Chatgpt 4o Latest 20250326: 43.1 (#107), Mistral Small 3.2: —

Long Context benchmarks
BenchmarkChatgpt 4o Latest 20250326Mistral Small 3.2
LMArena Longer Query1413—

Writing & Preference Chatgpt 4o Latest 20250326 leads

Chatgpt 4o Latest 20250326: 62.6 (#72), Mistral Small 3.2: 45.0 (#224)

Writing & Preference benchmarks
BenchmarkChatgpt 4o Latest 20250326Mistral Small 3.2
EQ-Bench Creative Writing15011255
LMArena Text1429—
LMArena Creative Writing1405—
LMArena Multi-Turn1454—

Frequently asked questions

Is Chatgpt 4o Latest 20250326 better than Mistral Small 3.2?

Chatgpt 4o Latest 20250326 is the stronger model overall, scoring 43.8 to 31.2 on the Noometry Index.

How many benchmarks do Chatgpt 4o Latest 20250326 and Mistral Small 3.2 share?

2 benchmarks have published results for both models. Chatgpt 4o Latest 20250326 has 21 scored results on Noometry and Mistral Small 3.2 has 6.

Related comparisons

Go deeper