Model comparison

Gemini 1.5 Pro (May 2024) vs Ring-2.6-1T

Gemini 1.5 Pro (May 2024) has enough public results to be ranked (#261); Ring-2.6-1T does not yet, so treat this comparison as directional.

Last verified . 0 shared benchmarks.

Gemini 1.5 Pro (May 2024) Google

32.1

Rank #261 Confirmed

Summary

  • The widest gap is in reasoning, where Ring-2.6-1T leads 26.1 to 12.3.
  • Ring-2.6-1T has downloadable open weights; the other is API-only.

Side by side

Gemini 1.5 Pro (May 2024) and Ring-2.6-1T specifications
Gemini 1.5 Pro (May 2024)Ring-2.6-1T
ProviderGoogleAnt Group (inclusionAI)
Noometry Index32.136.9
Released2024-02-152026-05-14
WeightsProprietaryOpen
Context window——
Max output——
Input $ / M tokens——
Output $ / M tokens——
Results tracked453

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Ring-2.6-1T leads

Gemini 1.5 Pro (May 2024): 34.2 (#241), Ring-2.6-1T: 40.7

Coding benchmarks
BenchmarkGemini 1.5 Pro (May 2024)Ring-2.6-1T
SciCode—42.4%
WeirdML22.2%—
BigCodeBench Instruct43.8%—
LMArena Coding1294—
BigCodeBench Complete57.5%—
CadEval34%—
ALE-Bench—432.57
HumanEval+79.3%—
MBPP+74.6%—

Agentic & Tool Use Not comparable

Gemini 1.5 Pro (May 2024): 17.9 (#145), Ring-2.6-1T: —

Agentic & Tool Use benchmarks
BenchmarkGemini 1.5 Pro (May 2024)Ring-2.6-1T
TheAgentCompany3.4%—
Cybench7.5%—
BALROG21%—

Reasoning Ring-2.6-1T leads

Gemini 1.5 Pro (May 2024): 12.3 (#338), Ring-2.6-1T: 26.1

Reasoning benchmarks
BenchmarkGemini 1.5 Pro (May 2024)Ring-2.6-1T
ARC-AGI-20.8%—
SimpleBench27.1%—
CritPt—3.7%
LMArena Hard Prompts1296—
DTBench59%—
BIG-Bench Hard89.2%—
Epoch Capabilities Index131.73—
ForecastBench58.4—

Math Not comparable

Gemini 1.5 Pro (May 2024): 25.8 (#266), Ring-2.6-1T: —

Math benchmarks
BenchmarkGemini 1.5 Pro (May 2024)Ring-2.6-1T
OTIS Mock AIME 2024-202523.1%—
Omni-MATH36.4%—
LMArena Math1315—
MATH Level 570.4%—

Knowledge Not comparable

Gemini 1.5 Pro (May 2024): 29.4 (#239), Ring-2.6-1T: —

Knowledge benchmarks
BenchmarkGemini 1.5 Pro (May 2024)Ring-2.6-1T
GPQA Diamond57.2%—
Humanity's Last Exam4.6%—
MMLU-Pro73.7%—
Confabulations13.5%—
GPQA (HELM)53.4%—
LMArena Expert1279—
MMLU86.9%—

Multimodal Not comparable

Gemini 1.5 Pro (May 2024): 36.8 (#77), Ring-2.6-1T: —

Multimodal benchmarks
BenchmarkGemini 1.5 Pro (May 2024)Ring-2.6-1T
LMArena Vision1161—
Video-MME75%—

Multilingual Not comparable

Gemini 1.5 Pro (May 2024): 45.3 (#174), Ring-2.6-1T: —

Multilingual benchmarks
BenchmarkGemini 1.5 Pro (May 2024)Ring-2.6-1T
LMArena Non-English1312—
LMArena Chinese1331—
LMArena French1302—
LMArena German1286—
LMArena Japanese1292—
LMArena Korean1298—
LMArena Russian1320—
LMArena Spanish1311—

Instruction Following Not comparable

Gemini 1.5 Pro (May 2024): 68.6 (#185), Ring-2.6-1T: —

Instruction Following benchmarks
BenchmarkGemini 1.5 Pro (May 2024)Ring-2.6-1T
IFEval83.7%—
LMArena Instruction Following1297—

Long Context Not comparable

Gemini 1.5 Pro (May 2024): 39.8 (#169), Ring-2.6-1T: —

Long Context benchmarks
BenchmarkGemini 1.5 Pro (May 2024)Ring-2.6-1T
LMArena Longer Query1308—

Writing & Preference Not comparable

Gemini 1.5 Pro (May 2024): 52.4 (#172), Ring-2.6-1T: —

Writing & Preference benchmarks
BenchmarkGemini 1.5 Pro (May 2024)Ring-2.6-1T
LMArena Text1319—
LMArena Creative Writing1333—
WildBench81.3%—
LMArena Multi-Turn1296—

Frequently asked questions

Is Gemini 1.5 Pro (May 2024) better than Ring-2.6-1T?

Gemini 1.5 Pro (May 2024) has enough public results to be ranked (#261); Ring-2.6-1T does not yet, so treat this comparison as directional.

Is Gemini 1.5 Pro (May 2024) or Ring-2.6-1T better for coding?

Ring-2.6-1T scores higher on coding benchmarks: 40.7 versus 34.2 in the Noometry coding category.

How many benchmarks do Gemini 1.5 Pro (May 2024) and Ring-2.6-1T share?

0 benchmarks have published results for both models. Gemini 1.5 Pro (May 2024) has 45 scored results on Noometry and Ring-2.6-1T has 3.

Related comparisons

Go deeper