Noometry

Model comparison

Olmo 3.1 32b Think vs Pixtral Large

Olmo 3.1 32b Think is the stronger model overall, scoring 37.3 to 31.7 on the Noometry Index.

Last verified . 0 shared benchmarks.

Olmo 3.1 32b Think Allen Institute for AI (Ai2)

37.3

Rank #191 Confirmed

Pixtral Large Mistral AI

31.7

Rank #257 Reported

Summary

  • The widest gap is in writing & preference, where Olmo 3.1 32b Think leads 46.4 to 32.9.

Side by side

Olmo 3.1 32b ThinkPixtral Large
ProviderAllen Institute for AI (Ai2)Mistral AI
Noometry Index37.331.7
Released—2024-11-01
WeightsOpenOpen
Context window—128K
Max output—128K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked153

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Olmo 3.1 32b Think: 37.1 (#186), Pixtral Large: —

BenchmarkOlmo 3.1 32b ThinkPixtral Large
LMArena Coding1292—

Reasoning Olmo 3.1 32b Think leads

Olmo 3.1 32b Think: 24.1 (#151), Pixtral Large: 20.9 (#208)

BenchmarkOlmo 3.1 32b ThinkPixtral Large
EnigmaEval—0.8%
LMArena Hard Prompts1272—

Math Not comparable

Olmo 3.1 32b Think: 33.6 (#170), Pixtral Large: —

BenchmarkOlmo 3.1 32b ThinkPixtral Large
LMArena Math1305—

Knowledge Not comparable

Olmo 3.1 32b Think: 35.0 (#178), Pixtral Large: —

BenchmarkOlmo 3.1 32b ThinkPixtral Large
LMArena Expert1294—

Multimodal Not comparable

Olmo 3.1 32b Think: —, Pixtral Large: 30.0 (#105)

BenchmarkOlmo 3.1 32b ThinkPixtral Large
LMArena Vision—1089

Multilingual Not comparable

Olmo 3.1 32b Think: 38.3 (#226), Pixtral Large: —

BenchmarkOlmo 3.1 32b ThinkPixtral Large
LMArena Non-English1210—
LMArena Chinese1241—
LMArena French1262—
LMArena German1260—
LMArena Russian1193—
LMArena Spanish1288—

Instruction Following Not comparable

Olmo 3.1 32b Think: 65.8 (#213), Pixtral Large: —

BenchmarkOlmo 3.1 32b ThinkPixtral Large
LMArena Instruction Following1246—

Long Context Not comparable

Olmo 3.1 32b Think: 38.6 (#190), Pixtral Large: —

BenchmarkOlmo 3.1 32b ThinkPixtral Large
LMArena Longer Query1272—

Writing & Preference Olmo 3.1 32b Think leads

Olmo 3.1 32b Think: 46.4 (#215), Pixtral Large: 32.9 (#273)

BenchmarkOlmo 3.1 32b ThinkPixtral Large
LMArena Text1271—
LMArena Creative Writing1226—
EQ-Bench Creative Writing—988
LMArena Multi-Turn1252—

Frequently asked questions

Is Olmo 3.1 32b Think better than Pixtral Large?

Olmo 3.1 32b Think is the stronger model overall, scoring 37.3 to 31.7 on the Noometry Index.

How many benchmarks do Olmo 3.1 32b Think and Pixtral Large share?

0 benchmarks have published results for both models. Olmo 3.1 32b Think has 15 scored results on Noometry and Pixtral Large has 3.

Related comparisons

Go deeper