Model comparison

Gemma 3 1B vs Mistral Large 3

Mistral Large 3 is the stronger model overall, scoring 39.1 to 21.1 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 3 1B Google

21.1

Rank #353 Reported

Mistral Large 3 Mistral AI

39.1

Rank #176 Confirmed

Summary

  • The widest gap is in knowledge, where Mistral Large 3 leads 36.0 to 7.0.

Side by side

Gemma 3 1B and Mistral Large 3 specifications
Gemma 3 1BMistral Large 3
ProviderGoogleMistral AI
Noometry Index21.139.1
Released2025-03-122025-12-02
WeightsOpenOpen
Context window—262K
Max output—8K
Input $ / M tokens—$0.25
Output $ / M tokens—$0.75
Results tracked424

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3 1B: —, Mistral Large 3: 34.4 (#237)

Coding benchmarks
BenchmarkGemma 3 1BMistral Large 3
LMArena WebDev—1230
LMArena Coding—1448

Agentic & Tool Use Not comparable

Gemma 3 1B: 13.7 (#152), Mistral Large 3: —

Agentic & Tool Use benchmarks
BenchmarkGemma 3 1BMistral Large 3
Berkeley Function Calling Leaderboard7.2%—

Reasoning Gemma 3 1B leads

Gemma 3 1B: 19.2 (#264), Mistral Large 3: 15.2 (#319)

Reasoning benchmarks
BenchmarkGemma 3 1BMistral Large 3
Kagi LLM Benchmark—50.9%
NYT Connections (extended)—7.5%
Chess Puzzles0%—
Thematic Generalization—23%
LMArena Hard Prompts—1429

Math Mistral Large 3 leads

Gemma 3 1B: 10.2 (#316), Mistral Large 3: 38.7 (#129)

Math benchmarks
BenchmarkGemma 3 1BMistral Large 3
OTIS Mock AIME 2024-20251.1%—
LMArena Math—1414

Knowledge Mistral Large 3 leads

Gemma 3 1B: 7.0 (#314), Mistral Large 3: 36.0 (#177)

Knowledge benchmarks
BenchmarkGemma 3 1BMistral Large 3
GPQA Diamond19.9%—
Vectara Hallucination Rate—14.5%
LMArena Expert—1421

Multimodal Not comparable

Gemma 3 1B: —, Mistral Large 3: 38.2 (#66)

Multimodal benchmarks
BenchmarkGemma 3 1BMistral Large 3
LMArena Vision—1221

Multilingual Not comparable

Gemma 3 1B: —, Mistral Large 3: 52.5 (#84)

Multilingual benchmarks
BenchmarkGemma 3 1BMistral Large 3
LMArena Non-English—1413
LMArena Chinese—1447
LMArena French—1455
LMArena German—1437
LMArena Japanese—1394
LMArena Korean—1384
LMArena Russian—1411
LMArena Spanish—1440

Instruction Following Not comparable

Gemma 3 1B: —, Mistral Large 3: 74.0 (#108)

Instruction Following benchmarks
BenchmarkGemma 3 1BMistral Large 3
LMArena Instruction Following—1403

Long Context Not comparable

Gemma 3 1B: —, Mistral Large 3: 43.1 (#105)

Long Context benchmarks
BenchmarkGemma 3 1BMistral Large 3
LMArena Longer Query—1413

Writing & Preference Not comparable

Gemma 3 1B: —, Mistral Large 3: 60.0 (#101)

Writing & Preference benchmarks
BenchmarkGemma 3 1BMistral Large 3
LMArena Text—1428
LMArena Creative Writing—1386
EQ-Bench Creative Writing—1412
LMArena Multi-Turn—1429

Frequently asked questions

Is Gemma 3 1B better than Mistral Large 3?

Mistral Large 3 is the stronger model overall, scoring 39.1 to 21.1 on the Noometry Index.

How many benchmarks do Gemma 3 1B and Mistral Large 3 share?

0 benchmarks have published results for both models. Gemma 3 1B has 4 scored results on Noometry and Mistral Large 3 has 24.

Related comparisons

Go deeper