Noometry

Model comparison

GPT-4.1 nano vs Mistral Small 3

Mistral Small 3 is the stronger model overall, scoring 30.9 to 27.7 on the Noometry Index.

Last verified . 18 shared benchmarks.

GPT-4.1 nano OpenAI

27.7

Rank #322 Confirmed

Mistral Small 3 Mistral AI

30.9

Rank #268 Confirmed

Summary

  • They share 18 benchmarks with published results for both. GPT-4.1 nano scores higher in 4 categories and Mistral Small 3 in 4 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in long context, where Mistral Small 3 leads 37.8 to 23.7.
  • The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 28.9% for GPT-4.1 nano and 6.7% for Mistral Small 3.
  • Mistral Small 3 is cheaper at $0.05 / $0.08 per million input/output tokens, against $0.10 / $0.40 for GPT-4.1 nano.
  • GPT-4.1 nano accepts more context: 1.05M tokens versus 33K.
  • Mistral Small 3 has downloadable open weights; the other is API-only.

Side by side

GPT-4.1 nanoMistral Small 3
ProviderOpenAIMistral AI
Noometry Index27.730.9
Released2025-04-142025-01-30
WeightsProprietaryOpen
Context window1.05M33K
Max output33K16K
Input $ / M tokens$0.10$0.05
Output $ / M tokens$0.40$0.08
Results tracked3824

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Small 3 leads

GPT-4.1 nano: 23.8 (#325), Mistral Small 3: 36.0 (#203)

BenchmarkGPT-4.1 nanoMistral Small 3
LMArena Coding13061246
Aider Polyglot8.9%—
SciCode25.9%—
WeirdML19%—
BigCodeBench Instruct—45.3%
BigCodeBench Complete—50.4%

Agentic & Tool Use Not comparable

GPT-4.1 nano: 26.3 (#98), Mistral Small 3: —

BenchmarkGPT-4.1 nanoMistral Small 3
Berkeley Function Calling Leaderboard33%—

Reasoning Mistral Small 3 leads

GPT-4.1 nano: 8.6 (#344), Mistral Small 3: 18.2 (#269)

BenchmarkGPT-4.1 nanoMistral Small 3
LMArena Hard Prompts12861233
Epoch Capabilities Index129.62127.06
ARC-AGI-20%—
Kagi LLM Benchmark33.3%—
ARC-AGI-10%—
CritPt0%—
Chess Puzzles—0%
DTBench52.5%—
LMCA5.5%—

Math GPT-4.1 nano leads

GPT-4.1 nano: 25.5 (#246), Mistral Small 3: 15.3 (#290)

BenchmarkGPT-4.1 nanoMistral Small 3
OTIS Mock AIME 2024-202528.9%6.7%
LMArena Math12741240
Omni-MATH36.7%—
MATH Level 570%—
FrontierMath (Feb 2025 set)1%—

Knowledge Mistral Small 3 leads

GPT-4.1 nano: 21.8 (#268), Mistral Small 3: 25.0 (#258)

BenchmarkGPT-4.1 nanoMistral Small 3
GPQA Diamond48.9%47.3%
LMArena Expert12721202
SimpleQA Verified6%—
MMLU-Pro55%—
Confabulations—25.2%
GPQA (HELM)50.7%—

Multimodal Not comparable

GPT-4.1 nano: 28.6 (#108), Mistral Small 3: —

BenchmarkGPT-4.1 nanoMistral Small 3
LMArena Vision1063—

Multilingual GPT-4.1 nano leads

GPT-4.1 nano: 41.8 (#200), Mistral Small 3: 37.5 (#231)

BenchmarkGPT-4.1 nanoMistral Small 3
LMArena Non-English12601198
LMArena Chinese12701204
LMArena German12881211
LMArena Japanese11991111
LMArena Russian12611216
LMArena French—1202
LMArena Korean—1188

Instruction Following GPT-4.1 nano leads

GPT-4.1 nano: 68.0 (#188), Mistral Small 3: 63.9 (#224)

BenchmarkGPT-4.1 nanoMistral Small 3
LMArena Instruction Following12671214
IFEval84.3%—

Long Context Mistral Small 3 leads

GPT-4.1 nano: 23.7 (#291), Mistral Small 3: 37.8 (#206)

BenchmarkGPT-4.1 nanoMistral Small 3
LMArena Longer Query12831246
Fiction.LiveBench25%—

Writing & Preference GPT-4.1 nano leads

GPT-4.1 nano: 40.7 (#238), Mistral Small 3: 32.4 (#275)

BenchmarkGPT-4.1 nanoMistral Small 3
LMArena Text12851234
LMArena Creative Writing12601195
EQ-Bench Creative Writing946707
LMArena Multi-Turn12771217
WildBench81.2%—

Frequently asked questions

Is GPT-4.1 nano better than Mistral Small 3?

Mistral Small 3 is the stronger model overall, scoring 30.9 to 27.7 on the Noometry Index.

Which is cheaper, GPT-4.1 nano or Mistral Small 3?

Mistral Small 3 is cheaper. It lists at $0.05 per million input tokens and $0.08 per million output tokens; GPT-4.1 nano lists at $0.10 and $0.40.

Is GPT-4.1 nano or Mistral Small 3 better for coding?

Mistral Small 3 scores higher on coding benchmarks: 36.0 versus 23.8 in the Noometry coding category.

Which has the bigger context window?

GPT-4.1 nano does, with 1.05M tokens against 33K.

How many benchmarks do GPT-4.1 nano and Mistral Small 3 share?

18 benchmarks have published results for both models. GPT-4.1 nano has 38 scored results on Noometry and Mistral Small 3 has 24.

Related comparisons

Go deeper