Model comparison

Phi-4 Mini vs Trinity Large Thinking

Trinity Large Thinking is the stronger model overall, scoring 38.1 to 30.4 on the Noometry Index. Phi-4 Mini costs 3.0× less per token, which makes it the better buy when Trinity Large Thinking's lead doesn't matter for your workload.

Last verified . 3 shared benchmarks.

Phi-4 Mini Microsoft

30.4

Rank #280 Reported

Trinity Large Thinking Arcee AI

38.1

Rank #180 Confirmed

Summary

  • They share 3 benchmarks with published results for both. Phi-4 Mini scores higher in 1 category and Trinity Large Thinking in 2 categories; 3 gaps are clear of the uncertainty.
  • The widest gap is in knowledge, where Trinity Large Thinking leads 40.3 to 24.8.
  • The biggest single-benchmark swing is SciCode: 10.8% for Phi-4 Mini and 36.1% for Trinity Large Thinking.
  • Phi-4 Mini is cheaper at $0.075 / $0.30 per million input/output tokens, against $0.25 / $0.80 for Trinity Large Thinking.
  • Trinity Large Thinking accepts more context: 262K tokens versus 128K.

Side by side

Phi-4 Mini and Trinity Large Thinking specifications
Phi-4 MiniTrinity Large Thinking
ProviderMicrosoftArcee AI
Noometry Index30.438.1
Released2024-12-112026-04-01
WeightsOpenOpen
Context window128K262K
Max output4K80K
Input $ / M tokens$0.075$0.25
Output $ / M tokens$0.30$0.80
Results tracked324

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Trinity Large Thinking leads

Phi-4 Mini: 27.6 (#312), Trinity Large Thinking: 33.8 (#238)

Coding benchmarks
BenchmarkPhi-4 MiniTrinity Large Thinking
SciCode10.8%36.1%
LMArena WebDev—1238
LMArena Coding—1381

Reasoning Phi-4 Mini leads

Phi-4 Mini: 21.7 (#190), Trinity Large Thinking: 16.3 (#298)

Reasoning benchmarks
BenchmarkPhi-4 MiniTrinity Large Thinking
CritPt0%0.9%
NYT Connections (extended)—16.5%
Thematic Generalization—41.6%
LMArena Hard Prompts—1350
Surface Evolver Bench—15.6%

Math Not comparable

Phi-4 Mini: —, Trinity Large Thinking: 34.9 (#149)

Math benchmarks
BenchmarkPhi-4 MiniTrinity Large Thinking
LMArena Math—1366

Knowledge Trinity Large Thinking leads

Phi-4 Mini: 24.8 (#261), Trinity Large Thinking: 40.3 (#107)

Knowledge benchmarks
BenchmarkPhi-4 MiniTrinity Large Thinking
Vectara Hallucination Rate23.5%6.9%
LMArena Expert—1359

Multilingual Not comparable

Phi-4 Mini: —, Trinity Large Thinking: 46.4 (#155)

Multilingual benchmarks
BenchmarkPhi-4 MiniTrinity Large Thinking
LMArena Non-English—1325
LMArena Chinese—1372
LMArena French—1374
LMArena German—1356
LMArena Japanese—1312
LMArena Korean—1304
LMArena Russian—1338
LMArena Spanish—1356

Instruction Following Not comparable

Phi-4 Mini: —, Trinity Large Thinking: 70.7 (#157)

Instruction Following benchmarks
BenchmarkPhi-4 MiniTrinity Large Thinking
LMArena Instruction Following—1334

Long Context Not comparable

Phi-4 Mini: —, Trinity Large Thinking: 41.2 (#139)

Long Context benchmarks
BenchmarkPhi-4 MiniTrinity Large Thinking
LMArena Longer Query—1355

Writing & Preference Not comparable

Phi-4 Mini: —, Trinity Large Thinking: 54.0 (#152)

Writing & Preference benchmarks
BenchmarkPhi-4 MiniTrinity Large Thinking
LMArena Text—1340
LMArena Creative Writing—1321
LMArena Multi-Turn—1342

Frequently asked questions

Is Phi-4 Mini better than Trinity Large Thinking?

Trinity Large Thinking is the stronger model overall, scoring 38.1 to 30.4 on the Noometry Index. Phi-4 Mini costs 3.0× less per token, which makes it the better buy when Trinity Large Thinking's lead doesn't matter for your workload.

Which is cheaper, Phi-4 Mini or Trinity Large Thinking?

Phi-4 Mini is cheaper. It lists at $0.075 per million input tokens and $0.30 per million output tokens; Trinity Large Thinking lists at $0.25 and $0.80.

Is Phi-4 Mini or Trinity Large Thinking better for coding?

Trinity Large Thinking scores higher on coding benchmarks: 33.8 versus 27.6 in the Noometry coding category.

Which has the bigger context window?

Trinity Large Thinking does, with 262K tokens against 128K.

How many benchmarks do Phi-4 Mini and Trinity Large Thinking share?

3 benchmarks have published results for both models. Phi-4 Mini has 3 scored results on Noometry and Trinity Large Thinking has 24.

Related comparisons

Go deeper