Noometry

Model comparison

Llama 4 Scout vs Phi-4 Mini

Phi-4 Mini is the stronger model overall, scoring 30.9 to 27.7 on the Noometry Index.

Last verified . 3 shared benchmarks.

Llama 4 Scout Meta

27.7

Rank #330 Confirmed

Phi-4 Mini Microsoft

30.9

Rank #283 Reported

Summary

  • They share 3 benchmarks with published results for both. Llama 4 Scout scores higher in 1 category and Phi-4 Mini in 2 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in reasoning, where Phi-4 Mini leads 22.4 to 9.1.
  • The biggest single-benchmark swing is Vectara Hallucination Rate: 7.7% for Llama 4 Scout and 23.5% for Phi-4 Mini.
  • Phi-4 Mini is cheaper at $0.075 / $0.30 per million input/output tokens, against $0.10 / $0.30 for Llama 4 Scout.

Side by side

Llama 4 ScoutPhi-4 Mini
ProviderMetaMicrosoft
Noometry Index27.730.9
Released2025-04-052024-12-11
WeightsOpenOpen
Context window128K128K
Max output4K4K
Input $ / M tokens$0.10$0.075
Output $ / M tokens$0.30$0.30
Results tracked433

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Phi-4 Mini leads

Llama 4 Scout: 20.2 (#339), Phi-4 Mini: 28.1 (#317)

BenchmarkLlama 4 ScoutPhi-4 Mini
SciCode17%10.8%
SWE-bench Verified (bash only)9.1%—
LMArena Coding1286—
BigCodeBench Complete43.1%—

Agentic & Tool Use Not comparable

Llama 4 Scout: 24.6 (#119), Phi-4 Mini: —

BenchmarkLlama 4 ScoutPhi-4 Mini
Berkeley Function Calling Leaderboard28.1%—

Reasoning Phi-4 Mini leads

Llama 4 Scout: 9.1 (#345), Phi-4 Mini: 22.4 (#195)

BenchmarkLlama 4 ScoutPhi-4 Mini
CritPt0%0%
ARC-AGI-20%—
Kagi LLM Benchmark36.9%—
ARC-AGI-10.5%—
LMArena Hard Prompts1266—
DTBench57.9%—
LMCA12%—
Epoch Capabilities Index129.64—
ForecastBench57.5—

Math Not comparable

Llama 4 Scout: 19.6 (#286), Phi-4 Mini: —

BenchmarkLlama 4 ScoutPhi-4 Mini
OTIS Mock AIME 2024-20257.8%—
Omni-MATH37.3%—
LMArena Math1287—
MATH Level 562.3%—
FrontierMath (Feb 2025 set)0%—

Knowledge Llama 4 Scout leads

Llama 4 Scout: 31.9 (#217), Phi-4 Mini: 25.3 (#262)

BenchmarkLlama 4 ScoutPhi-4 Mini
Vectara Hallucination Rate7.7%23.5%
GPQA Diamond51.8%—
MMLU-Pro74.2%—
GPQA (HELM)50.7%—
LMArena Expert1235—

Multimodal Not comparable

Llama 4 Scout: 32.2 (#102), Phi-4 Mini: —

BenchmarkLlama 4 ScoutPhi-4 Mini
LMArena Vision1118—
SpatialViz-Bench34.2%—

Multilingual Not comparable

Llama 4 Scout: 41.0 (#212), Phi-4 Mini: —

BenchmarkLlama 4 ScoutPhi-4 Mini
LMArena Non-English1252—
LMArena Chinese1255—
LMArena French1282—
LMArena German1272—
LMArena Japanese1206—
LMArena Korean1207—
LMArena Russian1263—
LMArena Spanish1278—

Instruction Following Not comparable

Llama 4 Scout: 65.8 (#217), Phi-4 Mini: —

BenchmarkLlama 4 ScoutPhi-4 Mini
IFEval81.8%—
LMArena Instruction Following1248—

Long Context Not comparable

Llama 4 Scout: 27.5 (#294), Phi-4 Mini: —

BenchmarkLlama 4 ScoutPhi-4 Mini
Fiction.LiveBench36%—
LMArena Longer Query1265—

Writing & Preference Not comparable

Llama 4 Scout: 37.0 (#261), Phi-4 Mini: —

BenchmarkLlama 4 ScoutPhi-4 Mini
LMArena Text1279—
LMArena Creative Writing1249—
EQ-Bench Creative Writing783—
WildBench78%—
LMArena Multi-Turn1280—

Frequently asked questions

Is Llama 4 Scout better than Phi-4 Mini?

Phi-4 Mini is the stronger model overall, scoring 30.9 to 27.7 on the Noometry Index.

Which is cheaper, Llama 4 Scout or Phi-4 Mini?

Phi-4 Mini is cheaper. It lists at $0.075 per million input tokens and $0.30 per million output tokens; Llama 4 Scout lists at $0.10 and $0.30.

Is Llama 4 Scout or Phi-4 Mini better for coding?

Phi-4 Mini scores higher on coding benchmarks: 28.1 versus 20.2 in the Noometry coding category.

Which has the bigger context window?

Both accept 128K tokens.

How many benchmarks do Llama 4 Scout and Phi-4 Mini share?

3 benchmarks have published results for both models. Llama 4 Scout has 43 scored results on Noometry and Phi-4 Mini has 3.

Related comparisons

Go deeper