Model comparison

GPT-5.4 nano vs Trinity Large Thinking

GPT-5.4 nano is the stronger model overall, scoring 41.9 to 38.6 on the Noometry Index.

Last verified . 20 shared benchmarks.

GPT-5.4 nano OpenAI

41.9

Rank #125 Confirmed

Trinity Large Thinking Arcee AI

38.6

Rank #185 Confirmed

Summary

  • They share 20 benchmarks with published results for both. GPT-5.4 nano scores higher in 8 categories and Trinity Large Thinking in 0 categories; 6 gaps are clear of the uncertainty.
  • The widest gap is in coding, where GPT-5.4 nano leads 43.6 to 34.1.
  • The biggest single-benchmark swing is SciCode: 46.9% for GPT-5.4 nano and 36.1% for Trinity Large Thinking.
  • Trinity Large Thinking is cheaper at $0.25 / $0.80 per million input/output tokens, against $0.20 / $1.25 for GPT-5.4 nano.
  • GPT-5.4 nano accepts more context: 400K tokens versus 262K.
  • Trinity Large Thinking has downloadable open weights; the other is API-only.

Side by side

GPT-5.4 nano and Trinity Large Thinking specifications
GPT-5.4 nanoTrinity Large Thinking
ProviderOpenAIArcee AI
Noometry Index41.938.6
Released2026-03-172026-04-01
WeightsProprietaryOpen
Context window400K262K
Max output128K80K
Input $ / M tokens$0.20$0.25
Output $ / M tokens$1.25$0.80
Results tracked4024

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-5.4 nano leads

GPT-5.4 nano: 43.6 (#84), Trinity Large Thinking: 34.1 (#244)

Coding benchmarks
BenchmarkGPT-5.4 nanoTrinity Large Thinking
SciCode46.9%36.1%
LMArena Coding14051381
LMArena WebDev—1238
WeirdML49.2%—
ALE-Bench1,005—

Reasoning GPT-5.4 nano leads

GPT-5.4 nano: 23.7 (#173), Trinity Large Thinking: 16.9 (#298)

Reasoning benchmarks
BenchmarkGPT-5.4 nanoTrinity Large Thinking
CritPt9.3%0.9%
LMArena Hard Prompts13811350
ARC-AGI-25.7%—
Kagi LLM Benchmark39.7%—
NYT Connections (extended)—16.5%
ARC-AGI-151.5%—
Chess Puzzles30%—
Thematic Generalization—41.6%
Mystery Game Puzzles9%—
DTBench80.3%—
LMCA36.9%—
Surface Evolver Bench—15.6%
Epoch Capabilities Index145.81—
ForecastBench57.3—

Math GPT-5.4 nano leads

GPT-5.4 nano: 40.9 (#88), Trinity Large Thinking: 37.6 (#149)

Math benchmarks
BenchmarkGPT-5.4 nanoTrinity Large Thinking
LMArena Math14061366
FrontierMath (Tiers 1-3)44.9%—
FrontierMath Tier 412.2%—
OTIS Mock AIME 2024-202587.8%—
ProofBench5%—
FrontierMath (Feb 2025 set)25.9%—
FrontierMath Tier 4 (v1)6.3%—

Knowledge Too close to call

GPT-5.4 nano: 41.9 (#103), Trinity Large Thinking: 40.9 (#113)

Knowledge benchmarks
BenchmarkGPT-5.4 nanoTrinity Large Thinking
Vectara Hallucination Rate3.1%6.9%
LMArena Expert13961360
GPQA Diamond78.5%—
SimpleQA Verified11.7%—

Multimodal Not comparable

GPT-5.4 nano: 36.7 (#78), Trinity Large Thinking: —

Multimodal benchmarks
BenchmarkGPT-5.4 nanoTrinity Large Thinking
LMArena Vision1196—

Multilingual GPT-5.4 nano leads

GPT-5.4 nano: 48.6 (#140), Trinity Large Thinking: 46.2 (#160)

Multilingual benchmarks
BenchmarkGPT-5.4 nanoTrinity Large Thinking
LMArena Non-English13591325
LMArena Chinese13921373
LMArena French13961374
LMArena German13671356
LMArena Japanese13431311
LMArena Korean13201306
LMArena Russian13631337
LMArena Spanish13711357

Instruction Following GPT-5.4 nano leads

GPT-5.4 nano: 71.9 (#144), Trinity Large Thinking: 70.5 (#162)

Instruction Following benchmarks
BenchmarkGPT-5.4 nanoTrinity Large Thinking
LMArena Instruction Following13621334

Long Context Too close to call

GPT-5.4 nano: 41.6 (#137), Trinity Large Thinking: 41.3 (#144)

Long Context benchmarks
BenchmarkGPT-5.4 nanoTrinity Large Thinking
LMArena Longer Query13661355

Writing & Preference GPT-5.4 nano leads

GPT-5.4 nano: 55.7 (#142), Trinity Large Thinking: 53.8 (#158)

Writing & Preference benchmarks
BenchmarkGPT-5.4 nanoTrinity Large Thinking
LMArena Text13721340
LMArena Creative Writing13141320
LMArena Multi-Turn13821342

Frequently asked questions

Is GPT-5.4 nano better than Trinity Large Thinking?

GPT-5.4 nano is the stronger model overall, scoring 41.9 to 38.6 on the Noometry Index.

Which is cheaper, GPT-5.4 nano or Trinity Large Thinking?

Trinity Large Thinking is cheaper. It lists at $0.25 per million input tokens and $0.80 per million output tokens; GPT-5.4 nano lists at $0.20 and $1.25.

Is GPT-5.4 nano or Trinity Large Thinking better for coding?

GPT-5.4 nano scores higher on coding benchmarks: 43.6 versus 34.1 in the Noometry coding category.

Which has the bigger context window?

GPT-5.4 nano does, with 400K tokens against 262K.

How many benchmarks do GPT-5.4 nano and Trinity Large Thinking share?

20 benchmarks have published results for both models. GPT-5.4 nano has 40 scored results on Noometry and Trinity Large Thinking has 24.

Related comparisons

Go deeper