Model comparison

Phi 3 Mini 128k Instruct vs Trinity Large Thinking

Trinity Large Thinking is the stronger model overall, scoring 38.1 to 29.1 on the Noometry Index.

Last verified . 17 shared benchmarks.

Phi 3 Mini 128k Instruct Microsoft

29.1

Rank #303 Confirmed

Trinity Large Thinking Arcee AI

38.1

Rank #180 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Phi 3 Mini 128k Instruct scores higher in 1 category and Trinity Large Thinking in 7 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Trinity Large Thinking leads 54.0 to 27.3.

Side by side

Phi 3 Mini 128k Instruct and Trinity Large Thinking specifications
Phi 3 Mini 128k InstructTrinity Large Thinking
ProviderMicrosoftArcee AI
Noometry Index29.138.1
Released2024-04-232026-04-01
WeightsOpenOpen
Context window—262K
Max output—80K
Input $ / M tokens—$0.25
Output $ / M tokens—$0.80
Results tracked1924

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Trinity Large Thinking leads

Phi 3 Mini 128k Instruct: 28.3 (#307), Trinity Large Thinking: 33.8 (#238)

Coding benchmarks
BenchmarkPhi 3 Mini 128k InstructTrinity Large Thinking
LMArena Coding10401381
LMArena WebDev—1238
SciCode—36.1%
BigCodeBench Instruct29.6%—
BigCodeBench Complete40.6%—

Reasoning Phi 3 Mini 128k Instruct leads

Phi 3 Mini 128k Instruct: 18.7 (#254), Trinity Large Thinking: 16.3 (#298)

Reasoning benchmarks
BenchmarkPhi 3 Mini 128k InstructTrinity Large Thinking
LMArena Hard Prompts10281350
NYT Connections (extended)—16.5%
CritPt—0.9%
Thematic Generalization—41.6%
Surface Evolver Bench—15.6%

Math Trinity Large Thinking leads

Phi 3 Mini 128k Instruct: 29.2 (#220), Trinity Large Thinking: 34.9 (#149)

Math benchmarks
BenchmarkPhi 3 Mini 128k InstructTrinity Large Thinking
LMArena Math10891366

Knowledge Trinity Large Thinking leads

Phi 3 Mini 128k Instruct: 26.3 (#251), Trinity Large Thinking: 40.3 (#107)

Knowledge benchmarks
BenchmarkPhi 3 Mini 128k InstructTrinity Large Thinking
LMArena Expert9841359
Vectara Hallucination Rate—6.9%

Multilingual Trinity Large Thinking leads

Phi 3 Mini 128k Instruct: 25.4 (#280), Trinity Large Thinking: 46.4 (#155)

Multilingual benchmarks
BenchmarkPhi 3 Mini 128k InstructTrinity Large Thinking
LMArena Non-English10001325
LMArena Chinese10161372
LMArena French10381374
LMArena German10061356
LMArena Japanese8991312
LMArena Korean8561304
LMArena Russian10041338
LMArena Spanish10581356

Instruction Following Trinity Large Thinking leads

Phi 3 Mini 128k Instruct: 52.1 (#289), Trinity Large Thinking: 70.7 (#157)

Instruction Following benchmarks
BenchmarkPhi 3 Mini 128k InstructTrinity Large Thinking
LMArena Instruction Following10231334

Long Context Trinity Large Thinking leads

Phi 3 Mini 128k Instruct: 30.3 (#284), Trinity Large Thinking: 41.2 (#139)

Long Context benchmarks
BenchmarkPhi 3 Mini 128k InstructTrinity Large Thinking
LMArena Longer Query9961355

Writing & Preference Trinity Large Thinking leads

Phi 3 Mini 128k Instruct: 27.3 (#296), Trinity Large Thinking: 54.0 (#152)

Writing & Preference benchmarks
BenchmarkPhi 3 Mini 128k InstructTrinity Large Thinking
LMArena Text10501340
LMArena Creative Writing10241321
LMArena Multi-Turn9891342

Frequently asked questions

Is Phi 3 Mini 128k Instruct better than Trinity Large Thinking?

Trinity Large Thinking is the stronger model overall, scoring 38.1 to 29.1 on the Noometry Index.

Is Phi 3 Mini 128k Instruct or Trinity Large Thinking better for coding?

Trinity Large Thinking scores higher on coding benchmarks: 33.8 versus 28.3 in the Noometry coding category.

How many benchmarks do Phi 3 Mini 128k Instruct and Trinity Large Thinking share?

17 benchmarks have published results for both models. Phi 3 Mini 128k Instruct has 19 scored results on Noometry and Trinity Large Thinking has 24.

Related comparisons

Go deeper