Model comparison

Mistral Small 3.1 vs Trinity Large Thinking

Trinity Large Thinking is the stronger model overall, scoring 38.6 to 31.7 on the Noometry Index.

Last verified . 17 shared benchmarks.

Mistral Small 3.1 Mistral AI

31.7

Rank #269 Confirmed

Trinity Large Thinking Arcee AI

38.6

Rank #185 Confirmed

Summary

  • They share 17 benchmarks with published results for both. Mistral Small 3.1 scores higher in 2 categories and Trinity Large Thinking in 6 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Trinity Large Thinking leads 37.6 to 14.7.
  • Both cost about the same: $0.35 input and $0.56 output per million tokens.
  • Trinity Large Thinking accepts more context: 262K tokens versus 128K.

Side by side

Mistral Small 3.1 and Trinity Large Thinking specifications
Mistral Small 3.1Trinity Large Thinking
ProviderMistral AIArcee AI
Noometry Index31.738.6
Released2025-03-172026-04-01
WeightsOpenOpen
Context window128K262K
Max output102K80K
Input $ / M tokens$0.35$0.25
Output $ / M tokens$0.56$0.80
Results tracked2824

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Small 3.1 leads

Mistral Small 3.1: 38.3 (#179), Trinity Large Thinking: 34.1 (#244)

Coding benchmarks
BenchmarkMistral Small 3.1Trinity Large Thinking
LMArena Coding13091381
LMArena WebDev—1238
SciCode—36.1%

Reasoning Mistral Small 3.1 leads

Mistral Small 3.1: 19.7 (#254), Trinity Large Thinking: 16.9 (#298)

Reasoning benchmarks
BenchmarkMistral Small 3.1Trinity Large Thinking
LMArena Hard Prompts12781350
NYT Connections (extended)—16.5%
CritPt—0.9%
Chess Puzzles1%—
Thematic Generalization—41.6%
Surface Evolver Bench—15.6%
Epoch Capabilities Index127.48—

Math Trinity Large Thinking leads

Mistral Small 3.1: 14.7 (#301), Trinity Large Thinking: 37.6 (#149)

Math benchmarks
BenchmarkMistral Small 3.1Trinity Large Thinking
LMArena Math12621366
OTIS Mock AIME 2024-20253.9%—
Omni-MATH24.8%—

Knowledge Trinity Large Thinking leads

Mistral Small 3.1: 22.6 (#271), Trinity Large Thinking: 40.9 (#113)

Knowledge benchmarks
BenchmarkMistral Small 3.1Trinity Large Thinking
LMArena Expert12571360
GPQA Diamond41.9%—
MMLU-Pro61%—
Vectara Hallucination Rate—6.9%
GPQA (HELM)39.2%—

Multimodal Not comparable

Mistral Small 3.1: 33.2 (#99), Trinity Large Thinking: —

Multimodal benchmarks
BenchmarkMistral Small 3.1Trinity Large Thinking
LMArena Vision1136—

Multilingual Trinity Large Thinking leads

Mistral Small 3.1: 41.2 (#209), Trinity Large Thinking: 46.2 (#160)

Multilingual benchmarks
BenchmarkMistral Small 3.1Trinity Large Thinking
LMArena Non-English12551325
LMArena Chinese12531373
LMArena French12731374
LMArena German12661356
LMArena Japanese12081311
LMArena Korean12061306
LMArena Russian12631337
LMArena Spanish12831357

Instruction Following Trinity Large Thinking leads

Mistral Small 3.1: 63.6 (#230), Trinity Large Thinking: 70.5 (#162)

Instruction Following benchmarks
BenchmarkMistral Small 3.1Trinity Large Thinking
LMArena Instruction Following12641334
IFEval75%—

Long Context Trinity Large Thinking leads

Mistral Small 3.1: 39.5 (#178), Trinity Large Thinking: 41.3 (#144)

Long Context benchmarks
BenchmarkMistral Small 3.1Trinity Large Thinking
LMArena Longer Query12991355

Writing & Preference Trinity Large Thinking leads

Mistral Small 3.1: 37.0 (#259), Trinity Large Thinking: 53.8 (#158)

Writing & Preference benchmarks
BenchmarkMistral Small 3.1Trinity Large Thinking
LMArena Text12771340
LMArena Creative Writing12531320
LMArena Multi-Turn12701342
EQ-Bench Creative Writing761—
WildBench78.8%—

Frequently asked questions

Is Mistral Small 3.1 better than Trinity Large Thinking?

Trinity Large Thinking is the stronger model overall, scoring 38.6 to 31.7 on the Noometry Index.

Which is cheaper, Mistral Small 3.1 or Trinity Large Thinking?

Trinity Large Thinking is cheaper. It lists at $0.25 per million input tokens and $0.80 per million output tokens; Mistral Small 3.1 lists at $0.35 and $0.56.

Is Mistral Small 3.1 or Trinity Large Thinking better for coding?

Mistral Small 3.1 scores higher on coding benchmarks: 38.3 versus 34.1 in the Noometry coding category.

Which has the bigger context window?

Trinity Large Thinking does, with 262K tokens against 128K.

How many benchmarks do Mistral Small 3.1 and Trinity Large Thinking share?

17 benchmarks have published results for both models. Mistral Small 3.1 has 28 scored results on Noometry and Trinity Large Thinking has 24.

Related comparisons

Go deeper