Model comparison

Mistral Large vs Trinity Large Thinking

Trinity Large Thinking is the stronger model overall, scoring 38.6 to 31.9 on the Noometry Index.

Last verified . 20 shared benchmarks.

Mistral Large Mistral AI

31.9

Rank #263 Confirmed

Trinity Large Thinking Arcee AI

38.6

Rank #185 Confirmed

Summary

  • They share 20 benchmarks with published results for both. Mistral Large scores higher in 1 category and Trinity Large Thinking in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where Trinity Large Thinking leads 37.6 to 18.2.
  • Trinity Large Thinking is cheaper at $0.25 / $0.80 per million input/output tokens, against $2 / $6 for Mistral Large.
  • Trinity Large Thinking accepts more context: 262K tokens versus 131K.

Side by side

Mistral Large and Trinity Large Thinking specifications
Mistral LargeTrinity Large Thinking
ProviderMistral AIArcee AI
Noometry Index31.938.6
Released2024-02-262026-04-01
WeightsOpenOpen
Context window131K262K
Max output16K80K
Input $ / M tokens$2$0.25
Output $ / M tokens$6$0.80
Results tracked5124

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Mistral Large: 34.3 (#240), Trinity Large Thinking: 34.1 (#244)

Coding benchmarks
BenchmarkMistral LargeTrinity Large Thinking
SciCode36.2%36.1%
LMArena Coding12771381
LMArena WebDev—1238
BigCodeBench Instruct30%—
LiveBench Coding47.1%—
BigCodeBench Complete38.3%—
ALE-Bench264.7—
HumanEval+62.2%—
MBPP+59.5%—

Agentic & Tool Use Not comparable

Mistral Large: 28.6 (#89), Trinity Large Thinking: —

Agentic & Tool Use benchmarks
BenchmarkMistral LargeTrinity Large Thinking
Berkeley Function Calling Leaderboard38.4%—

Reasoning Trinity Large Thinking leads

Mistral Large: 15.8 (#310), Trinity Large Thinking: 16.9 (#298)

Reasoning benchmarks
BenchmarkMistral LargeTrinity Large Thinking
CritPt0%0.9%
LMArena Hard Prompts12571350
SimpleBench22.5%—
NYT Connections (extended)—16.5%
Thematic Generalization—41.6%
LiveBench Reasoning43.5%—
DTBench65.1%—
LiveBench Data Analysis50.1%—
LMCA16.7%—
Surface Evolver Bench—15.6%
Epoch Capabilities Index128.52—
ForecastBench57.1—
LiveBench48.4%—

Math Trinity Large Thinking leads

Mistral Large: 18.2 (#291), Trinity Large Thinking: 37.6 (#149)

Math benchmarks
BenchmarkMistral LargeTrinity Large Thinking
LMArena Math12621366
OTIS Mock AIME 2024-20258.5%—
Omni-MATH28.1%—
LiveBench Math42.5%—
MATH Level 550.3%—
FrontierMath (Feb 2025 set)0.3%—

Knowledge Trinity Large Thinking leads

Mistral Large: 30.1 (#230), Trinity Large Thinking: 40.9 (#113)

Knowledge benchmarks
BenchmarkMistral LargeTrinity Large Thinking
Vectara Hallucination Rate4.5%6.9%
LMArena Expert12321360
GPQA Diamond51.3%—
MMLU-Pro59.9%—
Confabulations21.4%—
GPQA (HELM)43.5%—
MMLU80%—

Multilingual Trinity Large Thinking leads

Mistral Large: 40.0 (#219), Trinity Large Thinking: 46.2 (#160)

Multilingual benchmarks
BenchmarkMistral LargeTrinity Large Thinking
LMArena Non-English12371325
LMArena Chinese12401373
LMArena French13251374
LMArena German12541356
LMArena Japanese11881311
LMArena Korean12021306
LMArena Russian12571337
LMArena Spanish12681357

Instruction Following Trinity Large Thinking leads

Mistral Large: 67.9 (#191), Trinity Large Thinking: 70.5 (#162)

Instruction Following benchmarks
BenchmarkMistral LargeTrinity Large Thinking
LMArena Instruction Following12491334
LiveBench Instruction Following67.9%—
IFEval87.7%—

Long Context Trinity Large Thinking leads

Mistral Large: 38.3 (#199), Trinity Large Thinking: 41.3 (#144)

Long Context benchmarks
BenchmarkMistral LargeTrinity Large Thinking
LMArena Longer Query12611355

Writing & Preference Trinity Large Thinking leads

Mistral Large: 40.7 (#242), Trinity Large Thinking: 53.8 (#158)

Writing & Preference benchmarks
BenchmarkMistral LargeTrinity Large Thinking
LMArena Text12661340
LMArena Creative Writing12431320
LMArena Multi-Turn12601342
Short-Story Creative Writing69%—
EQ-Bench Creative Writing985—
WildBench80.1%—
LiveBench Language39.4%—

Frequently asked questions

Is Mistral Large better than Trinity Large Thinking?

Trinity Large Thinking is the stronger model overall, scoring 38.6 to 31.9 on the Noometry Index.

Which is cheaper, Mistral Large or Trinity Large Thinking?

Trinity Large Thinking is cheaper. It lists at $0.25 per million input tokens and $0.80 per million output tokens; Mistral Large lists at $2 and $6.

Is Mistral Large or Trinity Large Thinking better for coding?

They score almost the same on coding (34.3 vs 34.1); test both on your own repository before choosing.

Which has the bigger context window?

Trinity Large Thinking does, with 262K tokens against 131K.

How many benchmarks do Mistral Large and Trinity Large Thinking share?

20 benchmarks have published results for both models. Mistral Large has 51 scored results on Noometry and Trinity Large Thinking has 24.

Related comparisons

Go deeper