Model comparison

Gemma 7B vs Laguna M.1

Laguna M.1 is the stronger model overall, scoring 32.5 to 30.0 on the Noometry Index.

Last verified . 0 shared benchmarks.

Gemma 7B Google

30.0

Rank #299 Confirmed

Laguna M.1 Poolside

32.5

Rank #256 Reported

Summary

  • The widest gap is in math, where Gemma 7B leads 31.2 to 21.1.

Side by side

Gemma 7B and Laguna M.1 specifications
Gemma 7BLaguna M.1
ProviderGooglePoolside
Noometry Index30.032.5
Released2024-02-212026-04-28
WeightsOpenOpen
Context window—262K
Max output—33K
Input $ / M tokens——
Output $ / M tokens——
Results tracked273

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Laguna M.1 leads

Gemma 7B: 30.5 (#294), Laguna M.1: 36.6 (#204)

Coding benchmarks
BenchmarkGemma 7BLaguna M.1
LMArena WebDev—1349
LMArena Coding1048—
HumanEval+28.7%—
MBPP+43.4%—

Reasoning Laguna M.1 leads

Gemma 7B: 19.9 (#249), Laguna M.1: 23.1 (#184)

Reasoning benchmarks
BenchmarkGemma 7BLaguna M.1
LMArena Hard Prompts1042—
Surface Evolver Bench—15.6%
Adversarial NLI48.7%—
BIG-Bench Hard55.1%—
Epoch Capabilities Index111.99—
HellaSwag82.2%—
PIQA81.2%—
WinoGrande79%—

Math Gemma 7B leads

Gemma 7B: 31.2 (#228), Laguna M.1: 21.1 (#283)

Math benchmarks
BenchmarkGemma 7BLaguna M.1
ProofBench—0%
LMArena Math1066—
GSM8K46.4%—

Knowledge Not comparable

Gemma 7B: 27.3 (#252), Laguna M.1: —

Knowledge benchmarks
BenchmarkGemma 7BLaguna M.1
LMArena Expert1001—
ARC (AI2) Challenge78.3%—
BoolQ83.2%—
MMLU66.1%—
OpenBookQA78.6%—
TriviaQA72.3%—

Multilingual Not comparable

Gemma 7B: 25.1 (#287), Laguna M.1: —

Multilingual benchmarks
BenchmarkGemma 7BLaguna M.1
LMArena Non-English999—
LMArena Chinese1035—
LMArena French1025—
LMArena Russian993—

Instruction Following Not comparable

Gemma 7B: 51.5 (#295), Laguna M.1: —

Instruction Following benchmarks
BenchmarkGemma 7BLaguna M.1
LMArena Instruction Following1017—

Long Context Not comparable

Gemma 7B: 31.1 (#282), Laguna M.1: —

Long Context benchmarks
BenchmarkGemma 7BLaguna M.1
LMArena Longer Query1022—

Writing & Preference Not comparable

Gemma 7B: 27.1 (#302), Laguna M.1: —

Writing & Preference benchmarks
BenchmarkGemma 7BLaguna M.1
LMArena Text1056—
LMArena Creative Writing1024—
LMArena Multi-Turn963—

Frequently asked questions

Is Gemma 7B better than Laguna M.1?

Laguna M.1 is the stronger model overall, scoring 32.5 to 30.0 on the Noometry Index.

Is Gemma 7B or Laguna M.1 better for coding?

Laguna M.1 scores higher on coding benchmarks: 36.6 versus 30.5 in the Noometry coding category.

How many benchmarks do Gemma 7B and Laguna M.1 share?

0 benchmarks have published results for both models. Gemma 7B has 27 scored results on Noometry and Laguna M.1 has 3.

Related comparisons

Go deeper