Model comparison

Mistral Large 4 vs o3

o3 is the stronger model overall, scoring 47.5 to 43.1 on the Noometry Index. Mistral Large 4 costs 3.4× less per token, which makes it the better buy when o3's lead doesn't matter for your workload.

Last verified October 10, 2026. 13 shared benchmarks.

Mistral Large 4

Mistral AI

43.1

Rank #99 Confirmed

o3 OpenAI

47.5

Rank #61 Confirmed

Summary

They share 13 benchmarks with published results for both. Mistral Large 4 scores higher in 3 categories and o3 in 5 categories; 7 gaps are clear of the uncertainty.
The widest gap is in knowledge, where o3 leads 54.6 to 36.6.
The biggest single-benchmark swing is SimpleQA Verified: 20% for Mistral Large 4 and 49.4% for o3.
Mistral Large 4 is cheaper at $0.68 / $2.09 per million input/output tokens, against $2 / $8 for o3.
Mistral Large 4 accepts more context: 1.05M tokens versus 200K.

Side by side

Mistral Large 4 and o3 specifications
	Mistral Large 4	o3
Provider	Mistral AI	OpenAI
Noometry Index	43.1	47.5
Released	2026-10-06	2025-04-16
Weights	Proprietary	Proprietary
Context window	1.05M	200K
Max output	262K	100K
Input $ / M tokens	$0.68	$2
Output $ / M tokens	$2.09	$8
Results tracked	15	63

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Large 4 leads

Mistral Large 4: 48.6 (#57), o3: 46.8 (#64)

Coding benchmarks
Benchmark	Mistral Large 4	o3
LMArena Coding	1475	1408
SWE-bench Verified	—	62.3%
SWE-bench Verified (bash only)	—	58.4%
Aider Polyglot	—	81.3%
LMArena WebDev	1541	—
GSO	—	8.8%
WeirdML	—	52.4%
CadEval	—	74%
ALE-Bench	—	933.55

Agentic & Tool Use Not comparable

Mistral Large 4: —, o3: 34.5 (#44)

Agentic & Tool Use benchmarks
Benchmark	Mistral Large 4	o3
Berkeley Function Calling Leaderboard	—	63%
GDPval	—	30.8%
DeepResearch Bench	—	45.2%
OSWorld	—	23%
LMArena Search	—	1144
METR Time Horizons	—	65.4%

Reasoning o3 leads

Mistral Large 4: 22.5 (#192), o3: 32.0 (#78)

Reasoning benchmarks
Benchmark	Mistral Large 4	o3
LMArena Hard Prompts	1444	1402
ARC-AGI-2	—	6.5%
SimpleBench	—	53.1%
Kagi LLM Benchmark	—	67.6%
NYT Connections (extended)	27.4%	—
ARC-AGI-1	—	60.8%
CritPt	—	1.4%
Chess Puzzles	—	38%
EnigmaEval	—	13.1%
Mystery Game Puzzles	—	29%
DTBench	—	84.8%
LMCA	—	39.7%
Epoch Capabilities Index	—	146.86
ForecastBench	—	62.5

Math o3 leads

Mistral Large 4: 40.4 (#91), o3: 50.2 (#58)

Math benchmarks
Benchmark	Mistral Large 4	o3
LMArena Math	1488	1426
FrontierMath (Tiers 1-3)	—	33.3%
OTIS Mock AIME 2024-2025	—	84.4%
Omni-MATH	—	71.4%
MATH Level 5	—	97.8%
FrontierMath (Feb 2025 set)	—	18.7%
FrontierMath Tier 4 (v1)	—	2.1%

Knowledge o3 leads

Mistral Large 4: 36.6 (#166), o3: 54.6 (#52)

Knowledge benchmarks
Benchmark	Mistral Large 4	o3
SimpleQA Verified	20%	49.4%
LMArena Expert	1447	1402
GPQA Diamond	—	81.8%
Humanity's Last Exam	—	20.3%
MMLU-Pro	—	85.9%
Confabulations	—	14.4%
GPQA (HELM)	—	75.3%

Multimodal Not comparable

Mistral Large 4: —, o3: 41.4 (#36)

Multimodal benchmarks
Benchmark	Mistral Large 4	o3
LMArena Vision	—	1214
GeoBench	—	74%
VPCT	—	52%

Multilingual Too close to call

Mistral Large 4: 52.6 (#82), o3: 51.7 (#105)

Multilingual benchmarks
Benchmark	Mistral Large 4	o3
LMArena Non-English	1415	1401
LMArena Chinese	1491	1437
LMArena Russian	1414	1406
LMArena French	—	1430
LMArena German	—	1420
LMArena Japanese	—	1403
LMArena Korean	—	1370
LMArena Spanish	—	1395

Instruction Following Mistral Large 4 leads

Mistral Large 4: 75.0 (#76), o3: 72.8 (#127)

Instruction Following benchmarks
Benchmark	Mistral Large 4	o3
LMArena Instruction Following	1424	1368
IFEval	—	86.9%

Long Context o3 leads

Mistral Large 4: 43.6 (#89), o3: 53.3 (#6)

Long Context benchmarks
Benchmark	Mistral Large 4	o3
LMArena Longer Query	1429	1372
Fiction.LiveBench	—	88.9%
CL-bench	—	17.8%

Writing & Preference o3 leads

Mistral Large 4: 60.4 (#97), o3: 63.5 (#64)

Writing & Preference benchmarks
Benchmark	Mistral Large 4	o3
LMArena Text	1427	1410
LMArena Creative Writing	1361	1359
LMArena Multi-Turn	1424	1405
Short-Story Creative Writing	—	83.9%
EQ-Bench Creative Writing	—	1676
WildBench	—	86.1%

Frequently asked questions

Is Mistral Large 4 better than o3?

Which is cheaper, Mistral Large 4 or o3?

Mistral Large 4 is cheaper. It lists at $0.68 per million input tokens and $2.09 per million output tokens; o3 lists at $2 and $8.

Is Mistral Large 4 or o3 better for coding?

Mistral Large 4 scores higher on coding benchmarks: 48.6 versus 46.8 in the Noometry coding category.

Which has the bigger context window?

Mistral Large 4 does, with 1.05M tokens against 200K.

How many benchmarks do Mistral Large 4 and o3 share?

13 benchmarks have published results for both models. Mistral Large 4 has 15 scored results on Noometry and o3 has 63.