Model comparison
Gemma 3 1B vs Mistral Nemo
Mistral Nemo is the stronger model overall, scoring 26.4 to 21.1 on the Noometry Index.
Last verified . 2 shared benchmarks.
Google
Mistral AISummary
- They share 2 benchmarks with published results for both. Gemma 3 1B scores higher in 0 categories and Mistral Nemo in 4 categories; 4 gaps are clear of the uncertainty.
- The widest gap is in math, where Mistral Nemo leads 25.5 to 10.2.
- The biggest single-benchmark swing is Berkeley Function Calling Leaderboard: 7.2% for Gemma 3 1B and 27.6% for Mistral Nemo.
Side by side
| Gemma 3 1B | Mistral Nemo | |
|---|---|---|
| Provider | Mistral AI | |
| Noometry Index | 21.1 | 26.4 |
| Released | 2025-03-12 | 2024-07-01 |
| Weights | Open | Open |
| Context window | — | 128K |
| Max output | — | 128K |
| Input $ / M tokens | — | $0.15 |
| Output $ / M tokens | — | $0.15 |
| Results tracked | 4 | 10 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Agentic & Tool Use Mistral Nemo leads
Gemma 3 1B: 13.7 (#152), Mistral Nemo: 23.5 (#125)
| Benchmark | Gemma 3 1B | Mistral Nemo |
|---|---|---|
| Berkeley Function Calling Leaderboard | 7.2% | 27.6% |
| BALROG | — | 17.6% |
Reasoning Mistral Nemo leads
Gemma 3 1B: 19.2 (#264), Mistral Nemo: 20.7 (#232)
| Benchmark | Gemma 3 1B | Mistral Nemo |
|---|---|---|
| Chess Puzzles | 0% | — |
| DTBench | — | 48.6% |
| Epoch Capabilities Index | — | 118.68 |
| PIQA | — | 83.5% |
Math Mistral Nemo leads
Gemma 3 1B: 10.2 (#316), Mistral Nemo: 25.5 (#268)
| Benchmark | Gemma 3 1B | Mistral Nemo |
|---|---|---|
| OTIS Mock AIME 2024-2025 | 1.1% | — |
| MATH Level 5 | — | 10.8% |
| GSM8K | — | 84.2% |
Knowledge Mistral Nemo leads
Gemma 3 1B: 7.0 (#314), Mistral Nemo: 12.3 (#298)
| Benchmark | Gemma 3 1B | Mistral Nemo |
|---|---|---|
| GPQA Diamond | 19.9% | 29.9% |
| BoolQ | — | 82.5% |
Writing & Preference Not comparable
Gemma 3 1B: —, Mistral Nemo: 28.5 (#296)
| Benchmark | Gemma 3 1B | Mistral Nemo |
|---|---|---|
| EQ-Bench Creative Writing | — | 881 |
Frequently asked questions
Is Gemma 3 1B better than Mistral Nemo?
Mistral Nemo is the stronger model overall, scoring 26.4 to 21.1 on the Noometry Index.
How many benchmarks do Gemma 3 1B and Mistral Nemo share?
2 benchmarks have published results for both models. Gemma 3 1B has 4 scored results on Noometry and Mistral Nemo has 10.