Model comparison

Gemini 1.0 Pro vs Solar Pro4

Solar Pro4 is the stronger model overall, scoring 42.1 to 27.3 on the Noometry Index.

Last verified . 16 shared benchmarks.

Gemini 1.0 Pro Google

27.3

Rank #332 Confirmed

Solar Pro4 Upstage

42.1

Rank #121 Confirmed

Summary

  • They share 16 benchmarks with published results for both. Gemini 1.0 Pro scores higher in 0 categories and Solar Pro4 in 8 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where Solar Pro4 leads 38.8 to 9.3.

Side by side

Gemini 1.0 Pro and Solar Pro4 specifications
Gemini 1.0 ProSolar Pro4
ProviderGoogleUpstage
Noometry Index27.342.1
Released2023-12-132026-08-06
WeightsProprietaryProprietary
Context window—524K
Max output—131K
Input $ / M tokens—$0.30
Output $ / M tokens—$1.20
Results tracked2418

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Solar Pro4 leads

Gemini 1.0 Pro: 32.2 (#275), Solar Pro4: 40.1 (#149)

Coding benchmarks
BenchmarkGemini 1.0 ProSolar Pro4
LMArena Coding11081437
LMArena WebDev—1371
HumanEval+55.5%—
MBPP+61.4%—

Reasoning Solar Pro4 leads

Gemini 1.0 Pro: 17.1 (#296), Solar Pro4: 28.5 (#104)

Reasoning benchmarks
BenchmarkGemini 1.0 ProSolar Pro4
LMArena Hard Prompts11091399
DTBench45.9%—
Epoch Capabilities Index117.04—

Math Solar Pro4 leads

Gemini 1.0 Pro: 9.3 (#321), Solar Pro4: 38.8 (#128)

Math benchmarks
BenchmarkGemini 1.0 ProSolar Pro4
LMArena Math11321416
OTIS Mock AIME 2024-20251.1%—
MATH Level 511.2%—

Knowledge Solar Pro4 leads

Gemini 1.0 Pro: 15.6 (#291), Solar Pro4: 39.8 (#129)

Knowledge benchmarks
BenchmarkGemini 1.0 ProSolar Pro4
LMArena Expert10591427
GPQA Diamond34%—
MMLU70%—

Multilingual Solar Pro4 leads

Gemini 1.0 Pro: 33.4 (#252), Solar Pro4: 48.7 (#139)

Multilingual benchmarks
BenchmarkGemini 1.0 ProSolar Pro4
LMArena Non-English11381361
LMArena Chinese11241415
LMArena French11451397
LMArena German11251364
LMArena Japanese10231309
LMArena Russian11861360
LMArena Spanish11191401
LMArena Korean—1382

Instruction Following Solar Pro4 leads

Gemini 1.0 Pro: 57.6 (#267), Solar Pro4: 72.7 (#132)

Instruction Following benchmarks
BenchmarkGemini 1.0 ProSolar Pro4
LMArena Instruction Following11141377

Long Context Solar Pro4 leads

Gemini 1.0 Pro: 34.3 (#249), Solar Pro4: 42.1 (#130)

Long Context benchmarks
BenchmarkGemini 1.0 ProSolar Pro4
LMArena Longer Query11321381

Writing & Preference Solar Pro4 leads

Gemini 1.0 Pro: 36.0 (#264), Solar Pro4: 56.5 (#138)

Writing & Preference benchmarks
BenchmarkGemini 1.0 ProSolar Pro4
LMArena Text11491386
LMArena Creative Writing11311316
LMArena Multi-Turn11391385

Frequently asked questions

Is Gemini 1.0 Pro better than Solar Pro4?

Solar Pro4 is the stronger model overall, scoring 42.1 to 27.3 on the Noometry Index.

Is Gemini 1.0 Pro or Solar Pro4 better for coding?

Solar Pro4 scores higher on coding benchmarks: 40.1 versus 32.2 in the Noometry coding category.

How many benchmarks do Gemini 1.0 Pro and Solar Pro4 share?

16 benchmarks have published results for both models. Gemini 1.0 Pro has 24 scored results on Noometry and Solar Pro4 has 18.

Related comparisons

Go deeper