Model comparison

GPT-4o mini vs Qwen3-4B

Qwen3-4B is the stronger model overall, scoring 31.9 to 25.5 on the Noometry Index.

Last verified October 11, 2026. 3 shared benchmarks.

GPT-4o mini OpenAI

25.5

Rank #343 Confirmed

Qwen3-4B

Alibaba (Qwen)

31.9

Rank #264 Confirmed

Summary

They share 3 benchmarks with published results for both. GPT-4o mini scores higher in 0 categories and Qwen3-4B in 4 categories; 3 gaps are clear of the uncertainty.
The widest gap is in math, where Qwen3-4B leads 29.7 to 10.4.
The biggest single-benchmark swing is OTIS Mock AIME 2024-2025: 6.9% for GPT-4o mini and 52.2% for Qwen3-4B.
Qwen3-4B has downloadable open weights; the other is API-only.

Side by side

GPT-4o mini and Qwen3-4B specifications
	GPT-4o mini	Qwen3-4B
Provider	OpenAI	Alibaba (Qwen)
Noometry Index	25.5	31.9
Released	2024-07-18	2025-04-29
Weights	Proprietary	Open
Context window	128K	—
Max output	16K	—
Input $ / M tokens	$0.15	—
Output $ / M tokens	$0.60	—
Results tracked	60	6

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding Not comparable

GPT-4o mini: 22.0 (#335), Qwen3-4B: —

Coding benchmarks
Benchmark	GPT-4o mini	Qwen3-4B
Aider Polyglot	3.6%	—
WeirdML	11.8%	—
BigCodeBench Instruct	46.1%	—
LiveBench Coding	43.1%	—
LMArena Coding	1290	—
BigCodeBench Complete	57.4%	—
HumanEval+	83.5%	—
MBPP+	72.2%	—

Agentic & Tool Use Too close to call

GPT-4o mini: 27.5 (#101), Qwen3-4B: 27.6 (#100)

Agentic & Tool Use benchmarks
Benchmark	GPT-4o mini	Qwen3-4B
Berkeley Function Calling Leaderboard	—	35.7%
BALROG	17.4%	—

Reasoning Qwen3-4B leads

GPT-4o mini: 8.7 (#347), Qwen3-4B: 19.2 (#268)

Reasoning benchmarks
Benchmark	GPT-4o mini	Qwen3-4B
Chess Puzzles	0%	4%
ARC-AGI-2	0%	—
SimpleBench	10.7%	—
Kagi LLM Benchmark	28.8%	—
LiveBench Reasoning	32.8%	—
LMArena Hard Prompts	1267	—
Mystery Game Puzzles	12%	—
DTBench	54.4%	—
LiveBench Data Analysis	50%	—
LMCA	10.4%	—
Epoch Capabilities Index	126.56	—
LiveBench	41.3%	—
PIQA	88.7%	—

Math Qwen3-4B leads

GPT-4o mini: 10.4 (#314), Qwen3-4B: 29.7 (#240)

Math benchmarks
Benchmark	GPT-4o mini	Qwen3-4B
OTIS Mock AIME 2024-2025	6.9%	52.2%
FrontierMath (Tiers 1-3)	0.7%	—
MathArena Final-Answer Competitions	—	38.5%
Omni-MATH	28%	—
LiveBench Math	36.3%	—
LMArena Math	1267	—
MATH Level 5	52.6%	—
GSM8K	91.3%	—

Knowledge Qwen3-4B leads

GPT-4o mini: 17.7 (#284), Qwen3-4B: 33.0 (#208)

Knowledge benchmarks
Benchmark	GPT-4o mini	Qwen3-4B
GPQA Diamond	37.7%	52.3%
SimpleQA Verified	8.3%	—
MMLU-Pro	60.3%	—
Confabulations	37.2%	—
Vectara Hallucination Rate	—	5.7%
GPQA (HELM)	36.8%	—
LMArena Expert	1235	—
BoolQ	88.7%	—
MMLU	81.8%	—

Multimodal Not comparable

GPT-4o mini: 25.9 (#122), Qwen3-4B: —

Multimodal benchmarks
Benchmark	GPT-4o mini	Qwen3-4B
LMArena Vision	1066	—
Video-MME	64.8%	—
GeoBench	64%	—
VPCT	34%	—

Multilingual Not comparable

GPT-4o mini: 42.0 (#199), Qwen3-4B: —

Multilingual benchmarks
Benchmark	GPT-4o mini	Qwen3-4B
LMArena Non-English	1266	—
LMArena Chinese	1265	—
LMArena French	1297	—
LMArena German	1272	—
LMArena Japanese	1216	—
LMArena Korean	1195	—
LMArena Russian	1275	—
LMArena Spanish	1276	—

Instruction Following Not comparable

GPT-4o mini: 61.9 (#239), Qwen3-4B: —

Instruction Following benchmarks
Benchmark	GPT-4o mini	Qwen3-4B
LiveBench Instruction Following	56.8%	—
IFEval	78.2%	—
LMArena Instruction Following	1258	—

Long Context Not comparable

GPT-4o mini: 39.1 (#186), Qwen3-4B: —

Long Context benchmarks
Benchmark	GPT-4o mini	Qwen3-4B
LMArena Longer Query	1289	—

Writing & Preference Not comparable

GPT-4o mini: 39.5 (#248), Qwen3-4B: —

Writing & Preference benchmarks
Benchmark	GPT-4o mini	Qwen3-4B
LMArena Text	1286	—
LMArena Creative Writing	1268	—
Short-Story Creative Writing	67.2%	—
EQ-Bench Creative Writing	873	—
WildBench	79.1%	—
LMArena Multi-Turn	1285	—
LiveBench Language	28.6%	—

Frequently asked questions

Is GPT-4o mini better than Qwen3-4B?