Model comparison

Gemma 2 27B vs Sonar

Sonar is the stronger model overall, scoring 38.5 to 29.4 on the Noometry Index. Gemma 2 27B costs 1.5× less per token, which makes it the better buy when Sonar's lead doesn't matter for your workload.

Last verified . 7 shared benchmarks.

Gemma 2 27B Google

29.4

Rank #312 Confirmed

Sonar Perplexity

38.5

Rank #187 Confirmed

Summary

  • They share 7 benchmarks with published results for both. Gemma 2 27B scores higher in 0 categories and Sonar in 5 categories; 5 gaps are clear of the uncertainty.
  • The widest gap is in math, where Sonar leads 33.7 to 10.7.
  • The biggest single-benchmark swing is LiveBench Reasoning: 28.1% for Gemma 2 27B and 46.3% for Sonar.
  • Gemma 2 27B is cheaper at $0.65 / $0.65 per million input/output tokens, against $1 / $1 for Sonar.
  • Sonar accepts more context: 128K tokens versus 8K.
  • Gemma 2 27B has downloadable open weights; the other is API-only.

Side by side

Gemma 2 27B and Sonar specifications
Gemma 2 27BSonar
ProviderGooglePerplexity
Noometry Index29.438.5
Released2024-06-242024-01-01
WeightsOpenProprietary
Context window8K128K
Max output2K4K
Input $ / M tokens$0.65$1
Output $ / M tokens$0.65$1
Results tracked347

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Sonar leads

Gemma 2 27B: 34.1 (#246), Sonar: 35.7 (#221)

Coding benchmarks
BenchmarkGemma 2 27BSonar
LiveBench Coding36%35.1%
BigCodeBench Instruct42.8%—
LMArena Coding1211—
BigCodeBench Complete52.5%—

Reasoning Sonar leads

Gemma 2 27B: 15.3 (#315), Sonar: 21.1 (#227)

Reasoning benchmarks
BenchmarkGemma 2 27BSonar
LiveBench Reasoning28.1%46.3%
LiveBench Data Analysis47.9%37.9%
LiveBench38.2%46.9%
LMArena Hard Prompts1198—
DTBench48%—
LMCA7.1%—
Epoch Capabilities Index122.08—

Math Sonar leads

Gemma 2 27B: 10.7 (#311), Sonar: 33.7 (#200)

Math benchmarks
BenchmarkGemma 2 27BSonar
LiveBench Math26.5%41.6%
OTIS Mock AIME 2024-20251.4%—
LMArena Math1212—
MATH Level 527.9%—

Knowledge Not comparable

Gemma 2 27B: 19.0 (#280), Sonar: —

Knowledge benchmarks
BenchmarkGemma 2 27BSonar
GPQA Diamond36.5%—
Confabulations27.1%—
LMArena Expert1172—
MMLU75.7%—

Multilingual Not comparable

Gemma 2 27B: 38.6 (#226), Sonar: —

Multilingual benchmarks
BenchmarkGemma 2 27BSonar
LMArena Non-English1217—
LMArena Chinese1221—
LMArena French1247—
LMArena German1209—
LMArena Japanese1175—
LMArena Korean1174—
LMArena Russian1234—
LMArena Spanish1228—

Instruction Following Sonar leads

Gemma 2 27B: 60.5 (#249), Sonar: 71.4 (#150)

Instruction Following benchmarks
BenchmarkGemma 2 27BSonar
LiveBench Instruction Following58.1%76.2%
LMArena Instruction Following1206—

Long Context Not comparable

Gemma 2 27B: 37.3 (#218), Sonar: —

Long Context benchmarks
BenchmarkGemma 2 27BSonar
LMArena Longer Query1231—

Writing & Preference Sonar leads

Gemma 2 27B: 44.2 (#225), Sonar: 52.6 (#167)

Writing & Preference benchmarks
BenchmarkGemma 2 27BSonar
LiveBench Language32.6%44.1%
LMArena Text1231—
LMArena Creative Writing1241—
LMArena Multi-Turn1224—

Frequently asked questions

Is Gemma 2 27B better than Sonar?

Sonar is the stronger model overall, scoring 38.5 to 29.4 on the Noometry Index. Gemma 2 27B costs 1.5× less per token, which makes it the better buy when Sonar's lead doesn't matter for your workload.

Which is cheaper, Gemma 2 27B or Sonar?

Gemma 2 27B is cheaper. It lists at $0.65 per million input tokens and $0.65 per million output tokens; Sonar lists at $1 and $1.

Is Gemma 2 27B or Sonar better for coding?

Sonar scores higher on coding benchmarks: 35.7 versus 34.1 in the Noometry coding category.

Which has the bigger context window?

Sonar does, with 128K tokens against 8K.

How many benchmarks do Gemma 2 27B and Sonar share?

7 benchmarks have published results for both models. Gemma 2 27B has 34 scored results on Noometry and Sonar has 7.

Related comparisons

Go deeper