Model comparison

Gemma 3n E4b IT vs Pixtral Large

Gemma 3n E4b IT is the stronger model overall, scoring 37.3 to 32.2 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 3n E4b IT Google

37.3

Rank #206 Confirmed

Pixtral Large Mistral AI

32.2

Rank #259 Reported

Summary

  • The widest gap is in writing & preference, where Gemma 3n E4b IT leads 50.1 to 32.9.

Side by side

Gemma 3n E4b IT and Pixtral Large specifications
Gemma 3n E4b ITPixtral Large
ProviderGoogleMistral AI
Noometry Index37.332.2
Released—2024-11-01
WeightsOpenOpen
Context window—128K
Max output—128K
Input $ / M tokens—$2
Output $ / M tokens—$6
Results tracked183

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

Gemma 3n E4b IT: 37.0 (#198), Pixtral Large: —

Coding benchmarks
BenchmarkGemma 3n E4b ITPixtral Large
LMArena Coding1268—

Reasoning Pixtral Large leads

Gemma 3n E4b IT: 19.9 (#247), Pixtral Large: 21.7 (#218)

Reasoning benchmarks
BenchmarkGemma 3n E4b ITPixtral Large
Kagi LLM Benchmark31.5%—
EnigmaEval—0.8%
LMArena Hard Prompts1284—

Math Not comparable

Gemma 3n E4b IT: 35.1 (#188), Pixtral Large: —

Math benchmarks
BenchmarkGemma 3n E4b ITPixtral Large
LMArena Math1251—

Knowledge Not comparable

Gemma 3n E4b IT: 34.2 (#198), Pixtral Large: —

Knowledge benchmarks
BenchmarkGemma 3n E4b ITPixtral Large
LMArena Expert1246—

Multimodal Not comparable

Gemma 3n E4b IT: —, Pixtral Large: 30.6 (#111)

Multimodal benchmarks
BenchmarkGemma 3n E4b ITPixtral Large
LMArena Vision—1089

Multilingual Not comparable

Gemma 3n E4b IT: 43.4 (#183), Pixtral Large: —

Multilingual benchmarks
BenchmarkGemma 3n E4b ITPixtral Large
LMArena Non-English1285—
LMArena Chinese1309—
LMArena French1330—
LMArena German1311—
LMArena Japanese1272—
LMArena Korean1259—
LMArena Russian1288—
LMArena Spanish1305—

Instruction Following Not comparable

Gemma 3n E4b IT: 66.1 (#210), Pixtral Large: —

Instruction Following benchmarks
BenchmarkGemma 3n E4b ITPixtral Large
LMArena Instruction Following1255—

Long Context Not comparable

Gemma 3n E4b IT: 38.7 (#191), Pixtral Large: —

Long Context benchmarks
BenchmarkGemma 3n E4b ITPixtral Large
LMArena Longer Query1276—

Writing & Preference Gemma 3n E4b IT leads

Gemma 3n E4b IT: 50.1 (#186), Pixtral Large: 32.9 (#278)

Writing & Preference benchmarks
BenchmarkGemma 3n E4b ITPixtral Large
LMArena Text1306—
LMArena Creative Writing1287—
EQ-Bench Creative Writing—988
LMArena Multi-Turn1276—

Frequently asked questions

Is Gemma 3n E4b IT better than Pixtral Large?

Gemma 3n E4b IT is the stronger model overall, scoring 37.3 to 32.2 on the Noometry Index.

How many benchmarks do Gemma 3n E4b IT and Pixtral Large share?

0 benchmarks have published results for both models. Gemma 3n E4b IT has 18 scored results on Noometry and Pixtral Large has 3.

Related comparisons

Go deeper