Model comparison
Gemma 3 12B vs Pixtral Large
Gemma 3 12B and Pixtral Large score almost the same on the Noometry Index (32.1 vs 32.2), so choose on price, context window or the category you care about most.
Last verified . 1 shared benchmarks.
Google
Mistral AISummary
- They share 1 benchmark with published results for both. Gemma 3 12B scores higher in 1 category and Pixtral Large in 1 category; 2 gaps are clear of the uncertainty.
- The widest gap is in writing & preference, where Gemma 3 12B leads 47.5 to 32.9.
- Gemma 3 12B is cheaper at $0.05 / $0.15 per million input/output tokens, against $2 / $6 for Pixtral Large.
- Gemma 3 12B accepts more context: 131K tokens versus 128K.
Side by side
| Gemma 3 12B | Pixtral Large | |
|---|---|---|
| Provider | Mistral AI | |
| Noometry Index | 32.1 | 32.2 |
| Released | 2025-03-12 | 2024-11-01 |
| Weights | Open | Open |
| Context window | 131K | 128K |
| Max output | 8K | 128K |
| Input $ / M tokens | $0.05 | $2 |
| Output $ / M tokens | $0.15 | $6 |
| Results tracked | 24 | 3 |
Sponsored placements are available on pages like this one. Advertise on Noometry
Category by category
Coding Not comparable
Gemma 3 12B: 31.7 (#280), Pixtral Large: —
| Benchmark | Gemma 3 12B | Pixtral Large |
|---|---|---|
| SciCode | 17.4% | — |
| LMArena Coding | 1281 | — |
Agentic & Tool Use Not comparable
Gemma 3 12B: 25.5 (#108), Pixtral Large: —
| Benchmark | Gemma 3 12B | Pixtral Large |
|---|---|---|
| Berkeley Function Calling Leaderboard | 30.4% | — |
Reasoning Pixtral Large leads
Gemma 3 12B: 15.7 (#313), Pixtral Large: 21.7 (#218)
| Benchmark | Gemma 3 12B | Pixtral Large |
|---|---|---|
| CritPt | 0% | — |
| Chess Puzzles | 0% | — |
| EnigmaEval | — | 0.8% |
| LMArena Hard Prompts | 1309 | — |
| DTBench | 48.8% | — |
| LMCA | 4.5% | — |
| Epoch Capabilities Index | 123.5 | — |
Math Not comparable
Gemma 3 12B: 22.3 (#279), Pixtral Large: —
| Benchmark | Gemma 3 12B | Pixtral Large |
|---|---|---|
| OTIS Mock AIME 2024-2025 | 16.7% | — |
| LMArena Math | 1307 | — |
Knowledge Not comparable
Gemma 3 12B: 26.5 (#257), Pixtral Large: —
| Benchmark | Gemma 3 12B | Pixtral Large |
|---|---|---|
| GPQA Diamond | 39.5% | — |
| Vectara Hallucination Rate | 4.4% | — |
| LMArena Expert | 1248 | — |
Multimodal Not comparable
Gemma 3 12B: —, Pixtral Large: 30.6 (#111)
| Benchmark | Gemma 3 12B | Pixtral Large |
|---|---|---|
| LMArena Vision | — | 1089 |
| MindCube | 46.7% | — |
Multilingual Not comparable
Gemma 3 12B: 45.7 (#165), Pixtral Large: —
| Benchmark | Gemma 3 12B | Pixtral Large |
|---|---|---|
| LMArena Non-English | 1318 | — |
| LMArena German | 1370 | — |
| LMArena Russian | 1335 | — |
Instruction Following Not comparable
Gemma 3 12B: 68.6 (#186), Pixtral Large: —
| Benchmark | Gemma 3 12B | Pixtral Large |
|---|---|---|
| LMArena Instruction Following | 1299 | — |
Long Context Not comparable
Gemma 3 12B: 40.0 (#162), Pixtral Large: —
| Benchmark | Gemma 3 12B | Pixtral Large |
|---|---|---|
| LMArena Longer Query | 1317 | — |
Writing & Preference Gemma 3 12B leads
Gemma 3 12B: 47.5 (#209), Pixtral Large: 32.9 (#278)
| Benchmark | Gemma 3 12B | Pixtral Large |
|---|---|---|
| EQ-Bench Creative Writing | 1126 | 988 |
| LMArena Text | 1334 | — |
| LMArena Creative Writing | 1331 | — |
| LMArena Multi-Turn | 1334 | — |
Frequently asked questions
Is Gemma 3 12B better than Pixtral Large?
Gemma 3 12B and Pixtral Large score almost the same on the Noometry Index (32.1 vs 32.2), so choose on price, context window or the category you care about most.
Which is cheaper, Gemma 3 12B or Pixtral Large?
Gemma 3 12B is cheaper. It lists at $0.05 per million input tokens and $0.15 per million output tokens; Pixtral Large lists at $2 and $6.
Which has the bigger context window?
Gemma 3 12B does, with 131K tokens against 128K.
How many benchmarks do Gemma 3 12B and Pixtral Large share?
1 benchmark has published results for both models. Gemma 3 12B has 24 scored results on Noometry and Pixtral Large has 3.