Model comparison

Mistral Small vs Trinity Large Thinking

Trinity Large Thinking is the stronger model overall, scoring 38.6 to 33.4 on the Noometry Index.

Last verified . 20 shared benchmarks.

Mistral Small Mistral AI

33.4

Rank #243 Confirmed

Trinity Large Thinking Arcee AI

38.6

Rank #185 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Mistral Small scores higher in 1 category and Trinity Large Thinking in 7 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in math, where Trinity Large Thinking leads 37.6 to 16.4.
  • The biggest single-benchmark swing is SciCode: 26.5% for Mistral Small and 36.1% for Trinity Large Thinking.
  • Mistral Small is cheaper at $0.15 / $0.60 per million input/output tokens, against $0.25 / $0.80 for Trinity Large Thinking.

Side by side

Mistral Small and Trinity Large Thinking specifications
Mistral SmallTrinity Large Thinking
ProviderMistral AIArcee AI
Noometry Index33.438.6
Released2024-02-262026-04-01
WeightsOpenOpen
Context window262K262K
Max output256K80K
Input $ / M tokens$0.15$0.25
Output $ / M tokens$0.60$0.80
Results tracked3924

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Mistral Small: 34.0 (#247), Trinity Large Thinking: 34.1 (#244)

Coding benchmarks
BenchmarkMistral SmallTrinity Large Thinking
SciCode26.5%36.1%
LMArena Coding13621381
LMArena WebDev—1238
BigCodeBench Instruct36.1%—
LiveBench Coding36.2%—
BigCodeBench Complete46.6%—
ALE-Bench497.62—

Agentic & Tool Use Not comparable

Mistral Small: 28.1 (#93), Trinity Large Thinking: —

Agentic & Tool Use benchmarks
BenchmarkMistral SmallTrinity Large Thinking
Berkeley Function Calling Leaderboard37.1%—

Reasoning Mistral Small leads

Mistral Small: 19.8 (#250), Trinity Large Thinking: 16.9 (#298)

Reasoning benchmarks
BenchmarkMistral SmallTrinity Large Thinking
CritPt0%0.9%
LMArena Hard Prompts13351350
Kagi LLM Benchmark37.8%—
NYT Connections (extended)—16.5%
Thematic Generalization—41.6%
LiveBench Reasoning44.8%—
DTBench70.9%—
LiveBench Data Analysis53.7%—
LMCA20.6%—
Surface Evolver Bench—15.6%
LiveBench44%—

Math Trinity Large Thinking leads

Mistral Small: 16.4 (#293), Trinity Large Thinking: 37.6 (#149)

Math benchmarks
BenchmarkMistral SmallTrinity Large Thinking
LMArena Math13411366
OTIS Mock AIME 2024-20255.8%—
LiveBench Math39.9%—
MATH Level 546.8%—

Knowledge Trinity Large Thinking leads

Mistral Small: 31.0 (#222), Trinity Large Thinking: 40.9 (#113)

Knowledge benchmarks
BenchmarkMistral SmallTrinity Large Thinking
Vectara Hallucination Rate5.1%6.9%
LMArena Expert12911360
GPQA Diamond47.5%—
MMLU68.7%—

Multimodal Not comparable

Mistral Small: 33.5 (#96), Trinity Large Thinking: —

Multimodal benchmarks
BenchmarkMistral SmallTrinity Large Thinking
LMArena Vision1142—

Multilingual Too close to call

Mistral Small: 45.5 (#169), Trinity Large Thinking: 46.2 (#160)

Multilingual benchmarks
BenchmarkMistral SmallTrinity Large Thinking
LMArena Non-English13151325
LMArena Chinese13401373
LMArena French13371374
LMArena German13401356
LMArena Japanese12751311
LMArena Korean12591306
LMArena Russian13241337
LMArena Spanish13461357

Instruction Following Trinity Large Thinking leads

Mistral Small: 66.4 (#209), Trinity Large Thinking: 70.5 (#162)

Instruction Following benchmarks
BenchmarkMistral SmallTrinity Large Thinking
LMArena Instruction Following13101334
LiveBench Instruction Following63.7%—

Long Context Too close to call

Mistral Small: 40.4 (#156), Trinity Large Thinking: 41.3 (#144)

Long Context benchmarks
BenchmarkMistral SmallTrinity Large Thinking
LMArena Longer Query13271355

Writing & Preference Trinity Large Thinking leads

Mistral Small: 52.5 (#171), Trinity Large Thinking: 53.8 (#158)

Writing & Preference benchmarks
BenchmarkMistral SmallTrinity Large Thinking
LMArena Text13381340
LMArena Creative Writing13051320
LMArena Multi-Turn13441342
LiveBench Language30.5%—

Frequently asked questions

Is Mistral Small better than Trinity Large Thinking?

Trinity Large Thinking is the stronger model overall, scoring 38.6 to 33.4 on the Noometry Index.

Which is cheaper, Mistral Small or Trinity Large Thinking?

Mistral Small is cheaper. It lists at $0.15 per million input tokens and $0.60 per million output tokens; Trinity Large Thinking lists at $0.25 and $0.80.

Is Mistral Small or Trinity Large Thinking better for coding?

They score almost the same on coding (34.0 vs 34.1); test both on your own repository before choosing.

Which has the bigger context window?

Both accept 262K tokens.

How many benchmarks do Mistral Small and Trinity Large Thinking share?

20 benchmarks have published results for both models. Mistral Small has 39 scored results on Noometry and Trinity Large Thinking has 24.

Related comparisons

Go deeper