Model comparison

Gemma 3n E4b IT vs Sonar

Sonar is the stronger model overall, scoring 38.5 to 37.3 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 3n E4b IT Google

37.3

Rank #206 Confirmed

Sonar Perplexity

38.5

Rank #187 Confirmed

Summary

  • The widest gap is in instruction following, where Sonar leads 71.4 to 66.1.
  • Gemma 3n E4b IT has downloadable open weights; the other is API-only.

Side by side

Gemma 3n E4b IT and Sonar specifications
Gemma 3n E4b ITSonar
ProviderGooglePerplexity
Noometry Index37.338.5
Released—2024-01-01
WeightsOpenProprietary
Context window—128K
Max output—4K
Input $ / M tokens—$1
Output $ / M tokens—$1
Results tracked187

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemma 3n E4b IT leads

Gemma 3n E4b IT: 37.0 (#198), Sonar: 35.7 (#221)

Coding benchmarks
BenchmarkGemma 3n E4b ITSonar
LiveBench Coding—35.1%
LMArena Coding1268—

Reasoning Sonar leads

Gemma 3n E4b IT: 19.9 (#247), Sonar: 21.1 (#227)

Reasoning benchmarks
BenchmarkGemma 3n E4b ITSonar
Kagi LLM Benchmark31.5%—
LiveBench Reasoning—46.3%
LMArena Hard Prompts1284—
LiveBench Data Analysis—37.9%
LiveBench—46.9%

Math Gemma 3n E4b IT leads

Gemma 3n E4b IT: 35.1 (#188), Sonar: 33.7 (#200)

Math benchmarks
BenchmarkGemma 3n E4b ITSonar
LiveBench Math—41.6%
LMArena Math1251—

Knowledge Not comparable

Gemma 3n E4b IT: 34.2 (#198), Sonar: —

Knowledge benchmarks
BenchmarkGemma 3n E4b ITSonar
LMArena Expert1246—

Multilingual Not comparable

Gemma 3n E4b IT: 43.4 (#183), Sonar: —

Multilingual benchmarks
BenchmarkGemma 3n E4b ITSonar
LMArena Non-English1285—
LMArena Chinese1309—
LMArena French1330—
LMArena German1311—
LMArena Japanese1272—
LMArena Korean1259—
LMArena Russian1288—
LMArena Spanish1305—

Instruction Following Sonar leads

Gemma 3n E4b IT: 66.1 (#210), Sonar: 71.4 (#150)

Instruction Following benchmarks
BenchmarkGemma 3n E4b ITSonar
LiveBench Instruction Following—76.2%
LMArena Instruction Following1255—

Long Context Not comparable

Gemma 3n E4b IT: 38.7 (#191), Sonar: —

Long Context benchmarks
BenchmarkGemma 3n E4b ITSonar
LMArena Longer Query1276—

Writing & Preference Sonar leads

Gemma 3n E4b IT: 50.1 (#186), Sonar: 52.6 (#167)

Writing & Preference benchmarks
BenchmarkGemma 3n E4b ITSonar
LMArena Text1306—
LMArena Creative Writing1287—
LMArena Multi-Turn1276—
LiveBench Language—44.1%

Frequently asked questions

Is Gemma 3n E4b IT better than Sonar?

Sonar is the stronger model overall, scoring 38.5 to 37.3 on the Noometry Index.

Is Gemma 3n E4b IT or Sonar better for coding?

Gemma 3n E4b IT scores higher on coding benchmarks: 37.0 versus 35.7 in the Noometry coding category.

How many benchmarks do Gemma 3n E4b IT and Sonar share?

0 benchmarks have published results for both models. Gemma 3n E4b IT has 18 scored results on Noometry and Sonar has 7.

Related comparisons

Go deeper