Model comparison

Mistral Large 3 vs OLMo 2 Furious 13B

Mistral Large 3 is the stronger model overall, scoring 38.6 to 29.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Mistral Large 3 Mistral AI

38.6

Rank #172 Confirmed

Summary

  • The widest gap is in knowledge, where Mistral Large 3 leads 35.5 to 18.0.

Side by side

Mistral Large 3 and OLMo 2 Furious 13B specifications
Mistral Large 3OLMo 2 Furious 13B
ProviderMistral AIAllen Institute for AI (Ai2)
Noometry Index38.629.2
Released2025-12-022024-12-31
WeightsOpenOpen
Context window262K—
Max output8K—
Input $ / M tokens$0.25—
Output $ / M tokens$0.75—
Results tracked2412

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Mistral Large 3 leads

Mistral Large 3: 34.1 (#230), OLMo 2 Furious 13B: 28.1 (#309)

Coding benchmarks
BenchmarkMistral Large 3OLMo 2 Furious 13B
LMArena WebDev1230—
LiveBench Coding—10.4%
LMArena Coding1447—

Reasoning Too close to call

Mistral Large 3: 14.6 (#314), OLMo 2 Furious 13B: 14.8 (#312)

Reasoning benchmarks
BenchmarkMistral Large 3OLMo 2 Furious 13B
Kagi LLM Benchmark50.9%—
NYT Connections (extended)7.5%—
Thematic Generalization23%—
LiveBench Reasoning—16.3%
LMArena Hard Prompts1429—
LiveBench Data Analysis—20.6%
LiveBench—22.1%

Math Mistral Large 3 leads

Mistral Large 3: 36.0 (#131), OLMo 2 Furious 13B: 21.3 (#270)

Math benchmarks
BenchmarkMistral Large 3OLMo 2 Furious 13B
Omni-MATH—15.6%
LiveBench Math—13.6%
LMArena Math1415—

Knowledge Mistral Large 3 leads

Mistral Large 3: 35.5 (#173), OLMo 2 Furious 13B: 18.0 (#278)

Knowledge benchmarks
BenchmarkMistral Large 3OLMo 2 Furious 13B
MMLU-Pro—31%
Vectara Hallucination Rate14.5%—
GPQA (HELM)—31.6%
LMArena Expert1421—

Multimodal Not comparable

Mistral Large 3: 37.6 (#65), OLMo 2 Furious 13B: —

Multimodal benchmarks
BenchmarkMistral Large 3OLMo 2 Furious 13B
LMArena Vision1222—

Multilingual Not comparable

Mistral Large 3: 52.6 (#79), OLMo 2 Furious 13B: —

Multilingual benchmarks
BenchmarkMistral Large 3OLMo 2 Furious 13B
LMArena Non-English1412—
LMArena Chinese1448—
LMArena French1456—
LMArena German1438—
LMArena Japanese1399—
LMArena Korean1384—
LMArena Russian1412—
LMArena Spanish1437—

Instruction Following Mistral Large 3 leads

Mistral Large 3: 74.1 (#104), OLMo 2 Furious 13B: 61.1 (#243)

Instruction Following benchmarks
BenchmarkMistral Large 3OLMo 2 Furious 13B
LiveBench Instruction Following—60.6%
IFEval—73%
LMArena Instruction Following1402—

Long Context Not comparable

Mistral Large 3: 43.1 (#102), OLMo 2 Furious 13B: —

Long Context benchmarks
BenchmarkMistral Large 3OLMo 2 Furious 13B
LMArena Longer Query1413—

Writing & Preference Mistral Large 3 leads

Mistral Large 3: 60.2 (#100), OLMo 2 Furious 13B: 43.0 (#226)

Writing & Preference benchmarks
BenchmarkMistral Large 3OLMo 2 Furious 13B
LMArena Text1427—
LMArena Creative Writing1385—
EQ-Bench Creative Writing1412—
WildBench—68.9%
LMArena Multi-Turn1429—
LiveBench Language—11.2%

Frequently asked questions

Is Mistral Large 3 better than OLMo 2 Furious 13B?

Mistral Large 3 is the stronger model overall, scoring 38.6 to 29.2 on the Noometry Index.

Is Mistral Large 3 or OLMo 2 Furious 13B better for coding?

Mistral Large 3 scores higher on coding benchmarks: 34.1 versus 28.1 in the Noometry coding category.

How many benchmarks do Mistral Large 3 and OLMo 2 Furious 13B share?

0 benchmarks have published results for both models. Mistral Large 3 has 24 scored results on Noometry and OLMo 2 Furious 13B has 12.

Related comparisons

Go deeper