Noometry

Model comparison

Mistral Large 3 vs Phi-4 Mini

Mistral Large 3 is the stronger model overall, scoring 39.1 to 30.9 on the Noometry Index. Phi-4 Mini costs 2.9× less per token, which makes it the better buy when Mistral Large 3's lead doesn't matter for your workload.

Last verified . 1 shared benchmarks.

Mistral Large 3 Mistral AI

39.1

Rank #176 Confirmed

Phi-4 Mini Microsoft

30.9

Rank #283 Reported

Summary

  • They share 1 benchmark with published results for both. Mistral Large 3 scores higher in 2 categories and Phi-4 Mini in 1 category; 3 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Mistral Large 3 leads 36.0 to 25.3.
  • The biggest single-benchmark swing is Vectara Hallucination Rate: 14.5% for Mistral Large 3 and 23.5% for Phi-4 Mini.
  • Phi-4 Mini is cheaper at $0.075 / $0.30 per million input/output tokens, against $0.25 / $0.75 for Mistral Large 3.
  • Mistral Large 3 accepts more context: 262K tokens versus 128K.

Side by side

Mistral Large 3Phi-4 Mini
ProviderMistral AIMicrosoft
Noometry Index39.130.9
Released2025-12-022024-12-11
WeightsOpenOpen
Context window262K128K
Max output8K4K
Input $ / M tokens$0.25$0.075
Output $ / M tokens$0.75$0.30
Results tracked243

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Large 3 leads

Mistral Large 3: 34.4 (#237), Phi-4 Mini: 28.1 (#317)

BenchmarkMistral Large 3Phi-4 Mini
LMArena WebDev1230—
SciCode—10.8%
LMArena Coding1448—

Reasoning Phi-4 Mini leads

Mistral Large 3: 15.2 (#319), Phi-4 Mini: 22.4 (#195)

BenchmarkMistral Large 3Phi-4 Mini
Kagi LLM Benchmark50.9%—
NYT Connections (extended)7.5%—
CritPt—0%
Thematic Generalization23%—
LMArena Hard Prompts1429—

Math Not comparable

Mistral Large 3: 38.7 (#129), Phi-4 Mini: —

BenchmarkMistral Large 3Phi-4 Mini
LMArena Math1414—

Knowledge Mistral Large 3 leads

Mistral Large 3: 36.0 (#177), Phi-4 Mini: 25.3 (#262)

BenchmarkMistral Large 3Phi-4 Mini
Vectara Hallucination Rate14.5%23.5%
LMArena Expert1421—

Multimodal Not comparable

Mistral Large 3: 38.2 (#66), Phi-4 Mini: —

BenchmarkMistral Large 3Phi-4 Mini
LMArena Vision1221—

Multilingual Not comparable

Mistral Large 3: 52.5 (#84), Phi-4 Mini: —

BenchmarkMistral Large 3Phi-4 Mini
LMArena Non-English1413—
LMArena Chinese1447—
LMArena French1455—
LMArena German1437—
LMArena Japanese1394—
LMArena Korean1384—
LMArena Russian1411—
LMArena Spanish1440—

Instruction Following Not comparable

Mistral Large 3: 74.0 (#108), Phi-4 Mini: —

BenchmarkMistral Large 3Phi-4 Mini
LMArena Instruction Following1403—

Long Context Not comparable

Mistral Large 3: 43.1 (#105), Phi-4 Mini: —

BenchmarkMistral Large 3Phi-4 Mini
LMArena Longer Query1413—

Writing & Preference Not comparable

Mistral Large 3: 60.0 (#101), Phi-4 Mini: —

BenchmarkMistral Large 3Phi-4 Mini
LMArena Text1428—
LMArena Creative Writing1386—
EQ-Bench Creative Writing1412—
LMArena Multi-Turn1429—

Frequently asked questions

Is Mistral Large 3 better than Phi-4 Mini?

Mistral Large 3 is the stronger model overall, scoring 39.1 to 30.9 on the Noometry Index. Phi-4 Mini costs 2.9× less per token, which makes it the better buy when Mistral Large 3's lead doesn't matter for your workload.

Which is cheaper, Mistral Large 3 or Phi-4 Mini?

Phi-4 Mini is cheaper. It lists at $0.075 per million input tokens and $0.30 per million output tokens; Mistral Large 3 lists at $0.25 and $0.75.

Is Mistral Large 3 or Phi-4 Mini better for coding?

Mistral Large 3 scores higher on coding benchmarks: 34.4 versus 28.1 in the Noometry coding category.

Which has the bigger context window?

Mistral Large 3 does, with 262K tokens against 128K.

How many benchmarks do Mistral Large 3 and Phi-4 Mini share?

1 benchmark has published results for both models. Mistral Large 3 has 24 scored results on Noometry and Phi-4 Mini has 3.

Related comparisons

Go deeper