Model comparison

Olmo 3 32b Think vs Pixtral Large

Olmo 3 32b Think is the stronger model overall, scoring 38.7 to 32.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Pixtral Large Mistral AI

32.2

Rank #259 Reported

Summary

  • The widest gap is in writing & preference, where Olmo 3 32b Think leads 49.1 to 32.9.

Side by side

Olmo 3 32b Think and Pixtral Large specifications
Olmo 3 32b ThinkPixtral Large
ProviderAllen Institute for AI (Ai2)Mistral AI
Noometry Index38.732.2
Released—2024-11-01
WeightsOpenOpen
Context window—128K
Max output—128K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked143

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Olmo 3 32b Think: 38.6 (#172), Pixtral Large: —

Coding benchmarks
BenchmarkOlmo 3 32b ThinkPixtral Large
LMArena Coding1319—

Reasoning Olmo 3 32b Think leads

Olmo 3 32b Think: 25.9 (#140), Pixtral Large: 21.7 (#218)

Reasoning benchmarks
BenchmarkOlmo 3 32b ThinkPixtral Large
EnigmaEval—0.8%
LMArena Hard Prompts1302—

Math Not comparable

Olmo 3 32b Think: 36.5 (#165), Pixtral Large: —

Math benchmarks
BenchmarkOlmo 3 32b ThinkPixtral Large
LMArena Math1316—

Knowledge Not comparable

Olmo 3 32b Think: 35.0 (#190), Pixtral Large: —

Knowledge benchmarks
BenchmarkOlmo 3 32b ThinkPixtral Large
LMArena Expert1273—

Multimodal Not comparable

Olmo 3 32b Think: —, Pixtral Large: 30.6 (#111)

Multimodal benchmarks
BenchmarkOlmo 3 32b ThinkPixtral Large
LMArena Vision—1089

Multilingual Not comparable

Olmo 3 32b Think: 41.2 (#210), Pixtral Large: —

Multilingual benchmarks
BenchmarkOlmo 3 32b ThinkPixtral Large
LMArena Non-English1255—
LMArena Chinese1300—
LMArena French1291—
LMArena German1290—
LMArena Russian1254—

Instruction Following Not comparable

Olmo 3 32b Think: 67.2 (#198), Pixtral Large: —

Instruction Following benchmarks
BenchmarkOlmo 3 32b ThinkPixtral Large
LMArena Instruction Following1275—

Long Context Not comparable

Olmo 3 32b Think: 39.4 (#182), Pixtral Large: —

Long Context benchmarks
BenchmarkOlmo 3 32b ThinkPixtral Large
LMArena Longer Query1296—

Writing & Preference Olmo 3 32b Think leads

Olmo 3 32b Think: 49.1 (#193), Pixtral Large: 32.9 (#278)

Writing & Preference benchmarks
BenchmarkOlmo 3 32b ThinkPixtral Large
LMArena Text1300—
LMArena Creative Writing1256—
EQ-Bench Creative Writing—988
LMArena Multi-Turn1290—

Frequently asked questions

Is Olmo 3 32b Think better than Pixtral Large?

Olmo 3 32b Think is the stronger model overall, scoring 38.7 to 32.2 on the Noometry Index.

How many benchmarks do Olmo 3 32b Think and Pixtral Large share?

0 benchmarks have published results for both models. Olmo 3 32b Think has 14 scored results on Noometry and Pixtral Large has 3.

Related comparisons

Go deeper