Model comparison

Gemma 3 12B vs Wizardlm 13b

Gemma 3 12B and Wizardlm 13b score almost the same on the Noometry Index (32.1 vs 31.4), so choose on price, context window or the category you care about most.

Last verified . 9 shared benchmarks.

Gemma 3 12B Google

32.1

Rank #262 Confirmed

Wizardlm 13b Microsoft

31.4

Rank #274 Confirmed

Summary

  • They share 9 benchmarks with published results for both. Gemma 3 12B scores higher in 5 categories and Wizardlm 13b in 2 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in multilingual, where Gemma 3 12B leads 45.7 to 27.1.

Side by side

Gemma 3 12B and Wizardlm 13b specifications
Gemma 3 12BWizardlm 13b
ProviderGoogleMicrosoft
Noometry Index32.131.4
Released2025-03-12—
WeightsOpenOpen
Context window131K—
Max output8K—
Input $ / M tokens$0.05—
Output $ / M tokens$0.15—
Results tracked2410

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemma 3 12B leads

Gemma 3 12B: 31.7 (#280), Wizardlm 13b: 30.1 (#298)

Coding benchmarks
BenchmarkGemma 3 12BWizardlm 13b
LMArena Coding12811035
SciCode17.4%—

Agentic & Tool Use Not comparable

Gemma 3 12B: 25.5 (#108), Wizardlm 13b: —

Agentic & Tool Use benchmarks
BenchmarkGemma 3 12BWizardlm 13b
Berkeley Function Calling Leaderboard30.4%—

Reasoning Wizardlm 13b leads

Gemma 3 12B: 15.7 (#313), Wizardlm 13b: 19.4 (#259)

Reasoning benchmarks
BenchmarkGemma 3 12BWizardlm 13b
LMArena Hard Prompts13091018
CritPt0%—
Chess Puzzles0%—
DTBench48.8%—
LMCA4.5%—
Epoch Capabilities Index123.5—

Math Wizardlm 13b leads

Gemma 3 12B: 22.3 (#279), Wizardlm 13b: 30.2 (#238)

Math benchmarks
BenchmarkGemma 3 12BWizardlm 13b
LMArena Math13071017
OTIS Mock AIME 2024-202516.7%—

Knowledge Not comparable

Gemma 3 12B: 26.5 (#257), Wizardlm 13b: —

Knowledge benchmarks
BenchmarkGemma 3 12BWizardlm 13b
GPQA Diamond39.5%—
Vectara Hallucination Rate4.4%—
LMArena Expert1248—

Multimodal Not comparable

Gemma 3 12B: —, Wizardlm 13b: —

Multimodal benchmarks
BenchmarkGemma 3 12BWizardlm 13b
MindCube46.7%—

Multilingual Gemma 3 12B leads

Gemma 3 12B: 45.7 (#165), Wizardlm 13b: 27.1 (#277)

Multilingual benchmarks
BenchmarkGemma 3 12BWizardlm 13b
LMArena Non-English13181034
LMArena Chinese—1023
LMArena German1370—
LMArena Russian1335—

Instruction Following Gemma 3 12B leads

Gemma 3 12B: 68.6 (#186), Wizardlm 13b: 53.5 (#285)

Instruction Following benchmarks
BenchmarkGemma 3 12BWizardlm 13b
LMArena Instruction Following12991048

Long Context Gemma 3 12B leads

Gemma 3 12B: 40.0 (#162), Wizardlm 13b: 32.0 (#273)

Long Context benchmarks
BenchmarkGemma 3 12BWizardlm 13b
LMArena Longer Query13171054

Writing & Preference Gemma 3 12B leads

Gemma 3 12B: 47.5 (#209), Wizardlm 13b: 30.5 (#287)

Writing & Preference benchmarks
BenchmarkGemma 3 12BWizardlm 13b
LMArena Text13341077
LMArena Creative Writing13311091
LMArena Multi-Turn13341047
EQ-Bench Creative Writing1126—

Frequently asked questions

Is Gemma 3 12B better than Wizardlm 13b?

Gemma 3 12B and Wizardlm 13b score almost the same on the Noometry Index (32.1 vs 31.4), so choose on price, context window or the category you care about most.

Is Gemma 3 12B or Wizardlm 13b better for coding?

Gemma 3 12B scores higher on coding benchmarks: 31.7 versus 30.1 in the Noometry coding category.

How many benchmarks do Gemma 3 12B and Wizardlm 13b share?

9 benchmarks have published results for both models. Gemma 3 12B has 24 scored results on Noometry and Wizardlm 13b has 10.

Related comparisons

Go deeper