Model comparison

Gemini 1.5 Flash (May 2024) vs Hunyuan Turbos 20250226

Hunyuan Turbos 20250226 is the stronger model overall, scoring 41.3 to 33.2 on the Noometry Index.

Last verified . 16 shared benchmarks.

Gemini 1.5 Flash (May 2024) Google

33.2

Rank #246 Confirmed

Hunyuan Turbos 20250226 Tencent

41.3

Rank #139 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Gemini 1.5 Flash (May 2024) scores higher in 0 categories and Hunyuan Turbos 20250226 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Hunyuan Turbos 20250226 leads 37.5 to 22.1.

Side by side

Gemini 1.5 Flash (May 2024) and Hunyuan Turbos 20250226 specifications
Gemini 1.5 Flash (May 2024)Hunyuan Turbos 20250226
ProviderGoogleTencent
Noometry Index33.241.3
Released2024-05-14—
WeightsProprietaryProprietary
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked4216

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Hunyuan Turbos 20250226 leads

Gemini 1.5 Flash (May 2024): 34.4 (#236), Hunyuan Turbos 20250226: 40.0 (#152)

Coding benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Hunyuan Turbos 20250226
LMArena Coding12611361
WeirdML24.9%—
BigCodeBench Instruct43.5%—
BigCodeBench Complete55.1%—
HumanEval+75.6%—
MBPP+67.5%—

Agentic & Tool Use Not comparable

Gemini 1.5 Flash (May 2024): 26.6 (#102), Hunyuan Turbos 20250226: —

Agentic & Tool Use benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Hunyuan Turbos 20250226
BALROG14.6%—

Reasoning Hunyuan Turbos 20250226 leads

Gemini 1.5 Flash (May 2024): 21.7 (#215), Hunyuan Turbos 20250226: 27.8 (#113)

Reasoning benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Hunyuan Turbos 20250226
LMArena Hard Prompts12571374
DTBench53.8%—
Epoch Capabilities Index129.36—
ForecastBench53.9—
PIQA87.5%—

Math Hunyuan Turbos 20250226 leads

Gemini 1.5 Flash (May 2024): 22.1 (#281), Hunyuan Turbos 20250226: 37.5 (#154)

Math benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Hunyuan Turbos 20250226
LMArena Math12691359
OTIS Mock AIME 2024-202516.3%—
Omni-MATH30.4%—
MATH Level 561.9%—
FrontierMath (Feb 2025 set)0%—
GSM8K82.4%—

Knowledge Hunyuan Turbos 20250226 leads

Gemini 1.5 Flash (May 2024): 26.2 (#260), Hunyuan Turbos 20250226: 37.0 (#161)

Knowledge benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Hunyuan Turbos 20250226
LMArena Expert12331339
GPQA Diamond47.3%—
MMLU-Pro67.8%—
GPQA (HELM)43.7%—
BoolQ85.8%—
MMLU77.9%—

Multimodal Not comparable

Gemini 1.5 Flash (May 2024): 36.0 (#81), Hunyuan Turbos 20250226: —

Multimodal benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Hunyuan Turbos 20250226
LMArena Vision1141—
Video-MME70.3%—
GeoBench76%—

Multilingual Hunyuan Turbos 20250226 leads

Gemini 1.5 Flash (May 2024): 42.9 (#189), Hunyuan Turbos 20250226: 48.9 (#136)

Multilingual benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Hunyuan Turbos 20250226
LMArena Non-English12781363
LMArena Chinese12951417
LMArena French12581391
LMArena German12621355
LMArena Japanese12521342
LMArena Korean12211351
LMArena Russian12881368
LMArena Spanish1243—

Instruction Following Hunyuan Turbos 20250226 leads

Gemini 1.5 Flash (May 2024): 66.8 (#205), Hunyuan Turbos 20250226: 71.0 (#158)

Instruction Following benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Hunyuan Turbos 20250226
LMArena Instruction Following12581344
IFEval83.1%—

Long Context Hunyuan Turbos 20250226 leads

Gemini 1.5 Flash (May 2024): 39.0 (#187), Hunyuan Turbos 20250226: 41.6 (#136)

Long Context benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Hunyuan Turbos 20250226
LMArena Longer Query12841366

Writing & Preference Hunyuan Turbos 20250226 leads

Gemini 1.5 Flash (May 2024): 48.7 (#196), Hunyuan Turbos 20250226: 57.4 (#128)

Writing & Preference benchmarks
BenchmarkGemini 1.5 Flash (May 2024)Hunyuan Turbos 20250226
LMArena Text12871377
LMArena Creative Writing12851359
LMArena Multi-Turn12531387
WildBench79.2%—

Frequently asked questions

Is Gemini 1.5 Flash (May 2024) better than Hunyuan Turbos 20250226?

Hunyuan Turbos 20250226 is the stronger model overall, scoring 41.3 to 33.2 on the Noometry Index.

Is Gemini 1.5 Flash (May 2024) or Hunyuan Turbos 20250226 better for coding?

Hunyuan Turbos 20250226 scores higher on coding benchmarks: 40.0 versus 34.4 in the Noometry coding category.

How many benchmarks do Gemini 1.5 Flash (May 2024) and Hunyuan Turbos 20250226 share?

16 benchmarks have published results for both models. Gemini 1.5 Flash (May 2024) has 42 scored results on Noometry and Hunyuan Turbos 20250226 has 16.

Related comparisons

Go deeper