Model comparison

Magistral Small vs Olmo 3.1 32b Think

Olmo 3.1 32b Think is the stronger model overall, scoring 37.3 to 29.9 on the Noometry Index.

Last verified . 0 shared benchmarks.

Magistral Small Mistral AI

29.9

Rank #289 Confirmed

Summary

  • The widest gap is in reasoning, where Olmo 3.1 32b Think leads 24.1 to 6.9.

Side by side

Magistral Small and Olmo 3.1 32b Think specifications
Magistral SmallOlmo 3.1 32b Think
ProviderMistral AIAllen Institute for AI (Ai2)
Noometry Index29.937.3
Released2025-06-10—
WeightsOpenOpen
Context window128K—
Max output40K—
Input $ / M tokens$0.50—
Output $ / M tokens$1.50—
Results tracked1015

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Too close to call

Magistral Small: 37.8 (#172), Olmo 3.1 32b Think: 37.1 (#186)

Coding benchmarks
BenchmarkMagistral SmallOlmo 3.1 32b Think
SciCode35.2%—
LMArena Coding—1292

Reasoning Olmo 3.1 32b Think leads

Magistral Small: 6.9 (#345), Olmo 3.1 32b Think: 24.1 (#151)

Reasoning benchmarks
BenchmarkMagistral SmallOlmo 3.1 32b Think
ARC-AGI-20%—
Kagi LLM Benchmark6.3%—
ARC-AGI-15%—
CritPt0.3%—
Chess Puzzles3%—
LMArena Hard Prompts—1272
DTBench61.3%—
Epoch Capabilities Index133.19—

Math Olmo 3.1 32b Think leads

Magistral Small: 24.9 (#253), Olmo 3.1 32b Think: 33.6 (#170)

Math benchmarks
BenchmarkMagistral SmallOlmo 3.1 32b Think
OTIS Mock AIME 2024-202530%—
LMArena Math—1305

Knowledge Olmo 3.1 32b Think leads

Magistral Small: 30.9 (#215), Olmo 3.1 32b Think: 35.0 (#178)

Knowledge benchmarks
BenchmarkMagistral SmallOlmo 3.1 32b Think
GPQA Diamond56.1%—
LMArena Expert—1294

Multilingual Not comparable

Magistral Small: —, Olmo 3.1 32b Think: 38.3 (#226)

Multilingual benchmarks
BenchmarkMagistral SmallOlmo 3.1 32b Think
LMArena Non-English—1210
LMArena Chinese—1241
LMArena French—1262
LMArena German—1260
LMArena Russian—1193
LMArena Spanish—1288

Instruction Following Not comparable

Magistral Small: —, Olmo 3.1 32b Think: 65.8 (#213)

Instruction Following benchmarks
BenchmarkMagistral SmallOlmo 3.1 32b Think
LMArena Instruction Following—1246

Long Context Not comparable

Magistral Small: —, Olmo 3.1 32b Think: 38.6 (#190)

Long Context benchmarks
BenchmarkMagistral SmallOlmo 3.1 32b Think
LMArena Longer Query—1272

Writing & Preference Not comparable

Magistral Small: —, Olmo 3.1 32b Think: 46.4 (#215)

Writing & Preference benchmarks
BenchmarkMagistral SmallOlmo 3.1 32b Think
LMArena Text—1271
LMArena Creative Writing—1226
LMArena Multi-Turn—1252

Frequently asked questions

Is Magistral Small better than Olmo 3.1 32b Think?

Olmo 3.1 32b Think is the stronger model overall, scoring 37.3 to 29.9 on the Noometry Index.

Is Magistral Small or Olmo 3.1 32b Think better for coding?

They score almost the same on coding (37.8 vs 37.1); test both on your own repository before choosing.

How many benchmarks do Magistral Small and Olmo 3.1 32b Think share?

0 benchmarks have published results for both models. Magistral Small has 10 scored results on Noometry and Olmo 3.1 32b Think has 15.

Related comparisons

Go deeper