Model comparison

GPT-4o vs Qwen3-4B

Qwen3-4B is the stronger model overall, scoring 31.9 to 28.6 on the Noometry Index.

Last verified October 11, 2026. 4 shared benchmarks.

GPT-4o OpenAI

28.6

Rank #324 Confirmed

Qwen3-4B

Alibaba (Qwen)

31.9

Rank #264 Confirmed

Summary

They share 4 benchmarks with published results for both. GPT-4o scores higher in 0 categories and Qwen3-4B in 4 categories; 4 gaps are clear of the uncertainty.
The widest gap is in math, where Qwen3-4B leads 29.7 to 10.6.
The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 6.4% for GPT-4o and 52.2% for Qwen3-4B.
Qwen3-4B has downloadable open weights; the other is API-only.

Side by side

GPT-4o and Qwen3-4B specifications
	GPT-4o	Qwen3-4B
Provider	OpenAI	Alibaba (Qwen)
Noometry Index	28.6	31.9
Released	2024-05-13	2025-04-29
Weights	Proprietary	Open
Context window	128K	—
Max output	16K	—
Input $ / M tokens	$2.50	—
Output $ / M tokens	$10	—
Results tracked	72	6

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

GPT-4o: 24.8 (#328), Qwen3-4B: —

Coding benchmarks
Benchmark	GPT-4o	Qwen3-4B
SWE-bench Verified	31%	—
SWE-bench Verified (bash only)	21.6%	—
Aider Polyglot	45.3%	—
GSO	0%	—
WeirdML	25.1%	—
BigCodeBench Instruct	51.1%	—
LiveBench Coding	51.4%	—
LMArena Coding	1297	—
BigCodeBench Complete	61.1%	—
CadEval	26%	—
HumanEval+	87.2%	—
MBPP+	72.2%	—

Agentic & Tool Use Qwen3-4B leads

GPT-4o: 21.0 (#141), Qwen3-4B: 27.6 (#100)

Agentic & Tool Use benchmarks
Benchmark	GPT-4o	Qwen3-4B
Berkeley Function Calling Leaderboard	—	35.7%
GDPval	9.9%	—
TheAgentCompany	8.6%	—
Cybench	12.5%	—
BALROG	32.3%	—
LMArena Search	1006	—
METR Time Horizons	40.8%	—

Reasoning Qwen3-4B leads

GPT-4o: 9.4 (#343), Qwen3-4B: 19.2 (#268)

Reasoning benchmarks
Benchmark	GPT-4o	Qwen3-4B
Chess Puzzles	13%	4%
ARC-AGI-2	0%	—
SimpleBench	17.8%	—
ARC-AGI-1	4.5%	—
CritPt	0%	—
EnigmaEval	0.8%	—
LiveBench Reasoning	55.8%	—
LMArena Hard Prompts	1281	—
DTBench	64.5%	—
LiveBench Data Analysis	60.9%	—
LMCA	16.6%	—
Epoch Capabilities Index	128.97	—
ForecastBench	57.7	—
LiveBench	55.3%	—

Math Qwen3-4B leads

GPT-4o: 10.6 (#312), Qwen3-4B: 29.7 (#240)

Math benchmarks
Benchmark	GPT-4o	Qwen3-4B
OTIS Mock AIME 2024-2025	6.4%	52.2%
FrontierMath (Tiers 1-3)	0.4%	—
MathArena Final-Answer Competitions	—	38.5%
Omni-MATH	29.3%	—
LiveBench Math	49.5%	—
LMArena Math	1285	—
MATH Level 5	53.3%	—
FrontierMath (Feb 2025 set)	0.3%	—

Knowledge Qwen3-4B leads

GPT-4o: 28.8 (#242), Qwen3-4B: 33.0 (#208)

Knowledge benchmarks
Benchmark	GPT-4o	Qwen3-4B
GPQA Diamond	49.2%	52.3%
Vectara Hallucination Rate	9.6%	5.7%
Humanity's Last Exam	2.7%	—
SimpleQA Verified	26%	—
MMLU-Pro	71.3%	—
Confabulations	15.3%	—
GPQA (HELM)	52%	—
LMArena Expert	1250	—
MMLU	88.1%	—

Multimodal Not comparable

GPT-4o: 34.5 (#91), Qwen3-4B: —

Multimodal benchmarks
Benchmark	GPT-4o	Qwen3-4B
LMArena Vision	1137	—
Video-MME	71.9%	—
GeoBench	71%	—
VPCT	40%	—
ScienceQA	88.5%	—

Multilingual Not comparable

GPT-4o: 43.2 (#186), Qwen3-4B: —

Multilingual benchmarks
Benchmark	GPT-4o	Qwen3-4B
LMArena Non-English	1283	—
LMArena Chinese	1277	—
LMArena French	1304	—
LMArena German	1282	—
LMArena Japanese	1257	—
LMArena Korean	1234	—
LMArena Russian	1286	—
LMArena Spanish	1292	—

Instruction Following Not comparable

GPT-4o: 66.6 (#207), Qwen3-4B: —

Instruction Following benchmarks
Benchmark	GPT-4o	Qwen3-4B
LiveBench Instruction Following	68.6%	—
IFEval	81.7%	—
LMArena Instruction Following	1278	—

Long Context Not comparable

GPT-4o: 39.4 (#179), Qwen3-4B: —

Long Context benchmarks
Benchmark	GPT-4o	Qwen3-4B
Fiction.LiveBench	66.7%	—
LMArena Longer Query	1289	—

Writing & Preference Not comparable

GPT-4o: 52.6 (#166), Qwen3-4B: —

Writing & Preference benchmarks
Benchmark	GPT-4o	Qwen3-4B
LMArena Text	1300	—
LMArena Creative Writing	1292	—
Short-Story Creative Writing	81.8%	—
WildBench	82.8%	—
LMArena Multi-Turn	1302	—
LiveBench Language	47.6%	—

Frequently asked questions

Is GPT-4o better than Qwen3-4B?