Noometry

Model comparison

Gemini 1.0 Pro vs GPT-4.1 nano

Gemini 1.0 Pro and GPT-4.1 nano score almost the same on the Noometry Index (27.3 vs 27.9), so choose on price, context window or the category you care about most.

Last verified . 19 shared benchmarks.

Gemini 1.0 Pro Google

27.3

Rank #332 Confirmed

GPT-4.1 nano OpenAI

27.9

Rank #327 Confirmed

Summary

  • They share 19 benchmarks with published results for both. Gemini 1.0 Pro scores higher in 3 categories and GPT-4.1 nano in 5 categories; 8 gaps are clear of the uncertainty.
  • The widest gap is in math, where GPT-4.1 nano leads 26.9 to 9.3.
  • The biggest single-benchmark swing is MATH Level 5: 11.2% for Gemini 1.0 Pro and 70% for GPT-4.1 nano.

Side by side

Gemini 1.0 ProGPT-4.1 nano
ProviderGoogleOpenAI
Noometry Index27.327.9
Released2023-12-132025-04-14
WeightsProprietaryProprietary
Context window—1.05M
Max output—33K
Input $ / M tokens—$0.10
Output $ / M tokens—$0.40
Results tracked2438

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Gemini 1.0 Pro leads

Gemini 1.0 Pro: 32.2 (#275), GPT-4.1 nano: 24.1 (#330)

BenchmarkGemini 1.0 ProGPT-4.1 nano
LMArena Coding11081306
Aider Polyglot—8.9%
SciCode—25.9%
WeirdML—19%
HumanEval+55.5%—
MBPP+61.4%—

Agentic & Tool Use Not comparable

Gemini 1.0 Pro: —, GPT-4.1 nano: 26.5 (#104)

BenchmarkGemini 1.0 ProGPT-4.1 nano
Berkeley Function Calling Leaderboard—33%

Reasoning Gemini 1.0 Pro leads

Gemini 1.0 Pro: 17.1 (#296), GPT-4.1 nano: 8.5 (#349)

BenchmarkGemini 1.0 ProGPT-4.1 nano
LMArena Hard Prompts11091286
DTBench45.9%52.5%
Epoch Capabilities Index117.04129.62
ARC-AGI-2—0%
Kagi LLM Benchmark—33.3%
ARC-AGI-1—0%
CritPt—0%
LMCA—5.5%

Math GPT-4.1 nano leads

Gemini 1.0 Pro: 9.3 (#321), GPT-4.1 nano: 26.9 (#252)

BenchmarkGemini 1.0 ProGPT-4.1 nano
OTIS Mock AIME 2024-20251.1%28.9%
LMArena Math11321274
MATH Level 511.2%70%
Omni-MATH—36.7%
FrontierMath (Feb 2025 set)—1%

Knowledge GPT-4.1 nano leads

Gemini 1.0 Pro: 15.6 (#291), GPT-4.1 nano: 21.8 (#273)

BenchmarkGemini 1.0 ProGPT-4.1 nano
GPQA Diamond34%48.9%
LMArena Expert10591272
SimpleQA Verified—6%
MMLU-Pro—55%
GPQA (HELM)—50.7%
MMLU70%—

Multimodal Not comparable

Gemini 1.0 Pro: —, GPT-4.1 nano: 29.2 (#113)

BenchmarkGemini 1.0 ProGPT-4.1 nano
LMArena Vision—1063

Multilingual GPT-4.1 nano leads

Gemini 1.0 Pro: 33.4 (#252), GPT-4.1 nano: 41.6 (#205)

BenchmarkGemini 1.0 ProGPT-4.1 nano
LMArena Non-English11381260
LMArena Chinese11241270
LMArena German11251288
LMArena Japanese10231198
LMArena Russian11861261
LMArena French1145—
LMArena Spanish1119—

Instruction Following GPT-4.1 nano leads

Gemini 1.0 Pro: 57.6 (#267), GPT-4.1 nano: 67.8 (#193)

BenchmarkGemini 1.0 ProGPT-4.1 nano
LMArena Instruction Following11141267
IFEval—84.3%

Long Context Gemini 1.0 Pro leads

Gemini 1.0 Pro: 34.3 (#249), GPT-4.1 nano: 23.7 (#296)

BenchmarkGemini 1.0 ProGPT-4.1 nano
LMArena Longer Query11321283
Fiction.LiveBench—25%

Writing & Preference GPT-4.1 nano leads

Gemini 1.0 Pro: 36.0 (#264), GPT-4.1 nano: 40.5 (#243)

BenchmarkGemini 1.0 ProGPT-4.1 nano
LMArena Text11491285
LMArena Creative Writing11311260
LMArena Multi-Turn11391277
EQ-Bench Creative Writing—946
WildBench—81.2%

Frequently asked questions

Is Gemini 1.0 Pro better than GPT-4.1 nano?

Gemini 1.0 Pro and GPT-4.1 nano score almost the same on the Noometry Index (27.3 vs 27.9), so choose on price, context window or the category you care about most.

Is Gemini 1.0 Pro or GPT-4.1 nano better for coding?

Gemini 1.0 Pro scores higher on coding benchmarks: 32.2 versus 24.1 in the Noometry coding category.

How many benchmarks do Gemini 1.0 Pro and GPT-4.1 nano share?

19 benchmarks have published results for both models. Gemini 1.0 Pro has 24 scored results on Noometry and GPT-4.1 nano has 38.

Related comparisons

Go deeper