Model comparison

Gemma 2B vs Hunyuan Turbo 0110

Hunyuan Turbo 0110 is the stronger model overall, scoring 39.0 to 29.1 on the Noometry Index.

Last verified . 11 shared benchmarks.

Gemma 2B Google

29.1

Rank #305 Confirmed

Hunyuan Turbo 0110 Tencent

39.0

Rank #165 Confirmed

Summary

  • They share 11 benchmarks with published results for both. Gemma 2B scores higher in 0 categories and Hunyuan Turbo 0110 in 7 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in writing & preference, where Hunyuan Turbo 0110 leads 50.4 to 24.1.
  • Gemma 2B has downloadable open weights; the other is API-only.

Side by side

Gemma 2B and Hunyuan Turbo 0110 specifications
Gemma 2BHunyuan Turbo 0110
ProviderGoogleTencent
Noometry Index29.139.0
Released2024-02-21—
WeightsOpenProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked2311

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hunyuan Turbo 0110 leads

Gemma 2B: 28.9 (#300), Hunyuan Turbo 0110: 38.0 (#168)

Coding benchmarks
BenchmarkGemma 2BHunyuan Turbo 0110
LMArena Coding10101320
HumanEval+20.7%—
MBPP+34.1%—

Reasoning Hunyuan Turbo 0110 leads

Gemma 2B: 17.9 (#275), Hunyuan Turbo 0110: 25.0 (#135)

Reasoning benchmarks
BenchmarkGemma 2BHunyuan Turbo 0110
LMArena Hard Prompts9891308
BIG-Bench Hard35.2%—
Epoch Capabilities Index93.57—
HellaSwag71.4%—
PIQA77.3%—
WinoGrande65.4%—

Math Hunyuan Turbo 0110 leads

Gemma 2B: 27.6 (#237), Hunyuan Turbo 0110: 32.9 (#180)

Math benchmarks
BenchmarkGemma 2BHunyuan Turbo 0110
LMArena Math10091273
GSM8K17.7%—

Knowledge Not comparable

Gemma 2B: —, Hunyuan Turbo 0110: —

Knowledge benchmarks
BenchmarkGemma 2BHunyuan Turbo 0110
ARC (AI2) Challenge42.1%—
BoolQ69.4%—
MMLU42.3%—
TriviaQA53.2%—

Multilingual Hunyuan Turbo 0110 leads

Gemma 2B: 23.1 (#289), Hunyuan Turbo 0110: 43.5 (#178)

Multilingual benchmarks
BenchmarkGemma 2BHunyuan Turbo 0110
LMArena Non-English9581285
LMArena Chinese9861358
LMArena Russian9371305

Instruction Following Hunyuan Turbo 0110 leads

Gemma 2B: 48.8 (#297), Hunyuan Turbo 0110: 67.7 (#190)

Instruction Following benchmarks
BenchmarkGemma 2BHunyuan Turbo 0110
LMArena Instruction Following9711279

Long Context Hunyuan Turbo 0110 leads

Gemma 2B: 29.9 (#286), Hunyuan Turbo 0110: 39.8 (#163)

Long Context benchmarks
BenchmarkGemma 2BHunyuan Turbo 0110
LMArena Longer Query9811309

Writing & Preference Hunyuan Turbo 0110 leads

Gemma 2B: 24.1 (#303), Hunyuan Turbo 0110: 50.4 (#176)

Writing & Preference benchmarks
BenchmarkGemma 2BHunyuan Turbo 0110
LMArena Text10021311
LMArena Creative Writing9861269
LMArena Multi-Turn9451303

Frequently asked questions

Is Gemma 2B better than Hunyuan Turbo 0110?

Hunyuan Turbo 0110 is the stronger model overall, scoring 39.0 to 29.1 on the Noometry Index.

Is Gemma 2B or Hunyuan Turbo 0110 better for coding?

Hunyuan Turbo 0110 scores higher on coding benchmarks: 38.0 versus 28.9 in the Noometry coding category.

How many benchmarks do Gemma 2B and Hunyuan Turbo 0110 share?

11 benchmarks have published results for both models. Gemma 2B has 23 scored results on Noometry and Hunyuan Turbo 0110 has 11.

Related comparisons

Go deeper