Model comparison

GPT-4 Turbo vs Wizardlm 13b

GPT-4 Turbo and Wizardlm 13b score almost the same on the Noometry Index (30.5 vs 31.4), so choose on price, context window or the category you care about most.

Last verified . 10 shared benchmarks.

GPT-4 Turbo OpenAI

30.5

Rank #292 Confirmed

Wizardlm 13b Microsoft

31.4

Rank #274 Confirmed

Summary

  • They share 10 benchmarks with published results for both. GPT-4 Turbo scores higher in 5 categories and Wizardlm 13b in 2 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where Wizardlm 13b leads 30.2 to 9.0.
  • Wizardlm 13b has downloadable open weights; the other is API-only.

Side by side

GPT-4 Turbo and Wizardlm 13b specifications
GPT-4 TurboWizardlm 13b
ProviderOpenAIMicrosoft
Noometry Index30.531.4
Released2023-11-06—
WeightsProprietaryOpen
Context window128K—
Max output4K—
Input $ / M tokens$10—
Output $ / M tokens$30—
Results tracked3610

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-4 Turbo leads

GPT-4 Turbo: 33.8 (#249), Wizardlm 13b: 30.1 (#298)

Coding benchmarks
BenchmarkGPT-4 TurboWizardlm 13b
LMArena Coding12681035
WeirdML18%—
BigCodeBench Instruct48.2%—
BigCodeBench Complete58.2%—
HumanEval+86.6%—
MBPP+73.3%—

Agentic & Tool Use Not comparable

GPT-4 Turbo: —, Wizardlm 13b: —

Agentic & Tool Use benchmarks
BenchmarkGPT-4 TurboWizardlm 13b
METR Time Horizons36.7%—

Reasoning Wizardlm 13b leads

GPT-4 Turbo: 15.3 (#317), Wizardlm 13b: 19.4 (#259)

Reasoning benchmarks
BenchmarkGPT-4 TurboWizardlm 13b
LMArena Hard Prompts12511018
SimpleBench25.1%—
Chess Puzzles6%—
DTBench61.6%—
LMCA9.8%—
Epoch Capabilities Index127.25—
ForecastBench59.4—

Math Wizardlm 13b leads

GPT-4 Turbo: 9.0 (#322), Wizardlm 13b: 30.2 (#238)

Math benchmarks
BenchmarkGPT-4 TurboWizardlm 13b
LMArena Math12721017
FrontierMath (Tiers 1-3)0.7%—
OTIS Mock AIME 2024-20256.7%—
MATH Level 546.7%—

Knowledge Not comparable

GPT-4 Turbo: 24.3 (#268), Wizardlm 13b: —

Knowledge benchmarks
BenchmarkGPT-4 TurboWizardlm 13b
GPQA Diamond46.6%—
Confabulations28.4%—
LMArena Expert1223—
MMLU81.3%—

Multimodal Not comparable

GPT-4 Turbo: 30.6 (#110), Wizardlm 13b: —

Multimodal benchmarks
BenchmarkGPT-4 TurboWizardlm 13b
LMArena Vision1090—

Multilingual GPT-4 Turbo leads

GPT-4 Turbo: 40.5 (#216), Wizardlm 13b: 27.1 (#277)

Multilingual benchmarks
BenchmarkGPT-4 TurboWizardlm 13b
LMArena Non-English12451034
LMArena Chinese12421023
LMArena French1276—
LMArena German1259—
LMArena Japanese1194—
LMArena Korean1187—
LMArena Russian1259—
LMArena Spanish1260—

Instruction Following GPT-4 Turbo leads

GPT-4 Turbo: 65.8 (#216), Wizardlm 13b: 53.5 (#285)

Instruction Following benchmarks
BenchmarkGPT-4 TurboWizardlm 13b
LMArena Instruction Following12491048

Long Context GPT-4 Turbo leads

GPT-4 Turbo: 38.0 (#206), Wizardlm 13b: 32.0 (#273)

Long Context benchmarks
BenchmarkGPT-4 TurboWizardlm 13b
LMArena Longer Query12541054

Writing & Preference GPT-4 Turbo leads

GPT-4 Turbo: 47.7 (#206), Wizardlm 13b: 30.5 (#287)

Writing & Preference benchmarks
BenchmarkGPT-4 TurboWizardlm 13b
LMArena Text12721077
LMArena Creative Writing12691091
LMArena Multi-Turn12671047

Frequently asked questions

Is GPT-4 Turbo better than Wizardlm 13b?

GPT-4 Turbo and Wizardlm 13b score almost the same on the Noometry Index (30.5 vs 31.4), so choose on price, context window or the category you care about most.

Is GPT-4 Turbo or Wizardlm 13b better for coding?

GPT-4 Turbo scores higher on coding benchmarks: 33.8 versus 30.1 in the Noometry coding category.

How many benchmarks do GPT-4 Turbo and Wizardlm 13b share?

10 benchmarks have published results for both models. GPT-4 Turbo has 36 scored results on Noometry and Wizardlm 13b has 10.

Related comparisons

Go deeper