Noometry

Model comparison

Phi 3 Small 8k Instruct vs Trinity Large Thinking

Trinity Large Thinking is the stronger model overall, scoring 38.6 to 29.3 on the Noometry Index.

Last verified . 17 shared benchmarks.

Phi 3 Small 8k Instruct Microsoft

29.3

Rank #314 Confirmed

Trinity Large Thinking Arcee AI

38.6

Rank #185 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Phi 3 Small 8k Instruct scores higher in 0 categories and Trinity Large Thinking in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Trinity Large Thinking leads 53.8 to 31.1.

Side by side

Phi 3 Small 8k InstructTrinity Large Thinking
ProviderMicrosoftArcee AI
Noometry Index29.338.6
Released2024-04-232026-04-01
WeightsOpenOpen
Context window—262K
Max output—80K
Input $ / M tokens—$0.25
Output $ / M tokens—$0.80
Results tracked3224

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Trinity Large Thinking leads

Phi 3 Small 8k Instruct: 27.9 (#318), Trinity Large Thinking: 34.1 (#244)

BenchmarkPhi 3 Small 8k InstructTrinity Large Thinking
LMArena Coding11011381
LMArena WebDev—1238
SciCode—36.1%
LiveBench Coding20.3%—

Reasoning Trinity Large Thinking leads

Phi 3 Small 8k Instruct: 14.8 (#323), Trinity Large Thinking: 16.9 (#298)

BenchmarkPhi 3 Small 8k InstructTrinity Large Thinking
LMArena Hard Prompts11001350
NYT Connections (extended)—16.5%
CritPt—0.9%
Thematic Generalization—41.6%
LiveBench Reasoning15.9%—
LiveBench Data Analysis30.3%—
Surface Evolver Bench—15.6%
Adversarial NLI58.1%—
BIG-Bench Hard79.1%—
HellaSwag77%—
LiveBench24%—
WinoGrande81.5%—

Math Trinity Large Thinking leads

Phi 3 Small 8k Instruct: 27.6 (#248), Trinity Large Thinking: 37.6 (#149)

BenchmarkPhi 3 Small 8k InstructTrinity Large Thinking
LMArena Math11511366
LiveBench Math17.6%—

Knowledge Trinity Large Thinking leads

Phi 3 Small 8k Instruct: 29.1 (#240), Trinity Large Thinking: 40.9 (#113)

BenchmarkPhi 3 Small 8k InstructTrinity Large Thinking
LMArena Expert10671360
Vectara Hallucination Rate—6.9%
ARC (AI2) Challenge90.7%—
MMLU75.7%—
OpenBookQA88%—
TriviaQA58.1%—

Multilingual Trinity Large Thinking leads

Phi 3 Small 8k Instruct: 28.5 (#272), Trinity Large Thinking: 46.2 (#160)

BenchmarkPhi 3 Small 8k InstructTrinity Large Thinking
LMArena Non-English10581325
LMArena Chinese10611373
LMArena French11351374
LMArena German10801356
LMArena Japanese9661311
LMArena Korean8941306
LMArena Russian11111337
LMArena Spanish11111357

Instruction Following Trinity Large Thinking leads

Phi 3 Small 8k Instruct: 51.9 (#292), Trinity Large Thinking: 70.5 (#162)

BenchmarkPhi 3 Small 8k InstructTrinity Large Thinking
LMArena Instruction Following10871334
LiveBench Instruction Following47.2%—

Long Context Trinity Large Thinking leads

Phi 3 Small 8k Instruct: 33.0 (#267), Trinity Large Thinking: 41.3 (#144)

BenchmarkPhi 3 Small 8k InstructTrinity Large Thinking
LMArena Longer Query10881355

Writing & Preference Trinity Large Thinking leads

Phi 3 Small 8k Instruct: 31.1 (#284), Trinity Large Thinking: 53.8 (#158)

BenchmarkPhi 3 Small 8k InstructTrinity Large Thinking
LMArena Text11101340
LMArena Creative Writing10831320
LMArena Multi-Turn10681342
LiveBench Language12.9%—

Frequently asked questions

Is Phi 3 Small 8k Instruct better than Trinity Large Thinking?

Trinity Large Thinking is the stronger model overall, scoring 38.6 to 29.3 on the Noometry Index.

Is Phi 3 Small 8k Instruct or Trinity Large Thinking better for coding?

Trinity Large Thinking scores higher on coding benchmarks: 34.1 versus 27.9 in the Noometry coding category.

How many benchmarks do Phi 3 Small 8k Instruct and Trinity Large Thinking share?

17 benchmarks have published results for both models. Phi 3 Small 8k Instruct has 32 scored results on Noometry and Trinity Large Thinking has 24.

Related comparisons

Go deeper