Model comparison

GPT-4 Turbo vs Wizardlm 70b

Wizardlm 70b is the stronger model overall, scoring 33.0 to 30.5 on the Noometry Index.

Last verified . 12 shared benchmarks.

GPT-4 Turbo OpenAI

30.5

Rank #292 Confirmed

Wizardlm 70b Microsoft

33.0

Rank #249 Confirmed

Summary

  • They share 12 benchmarks with published results for both. GPT-4 Turbo scores higher in 5 categories and Wizardlm 70b in 2 categories; 7 gaps are clear of the uncertainty.
  • The widest gap is in math, where Wizardlm 70b leads 32.2 to 9.0.
  • Wizardlm 70b has downloadable open weights; the other is API-only.

Side by side

GPT-4 Turbo and Wizardlm 70b specifications
GPT-4 TurboWizardlm 70b
ProviderOpenAIMicrosoft
Noometry Index30.533.0
Released2023-11-06—
WeightsProprietaryOpen
Context window128K—
Max output4K—
Input $ / M tokens$10—
Output $ / M tokens$30—
Results tracked3612

Sponsored placements are available on pages like this one. Advertise on Noometry

Category by category

Coding GPT-4 Turbo leads

GPT-4 Turbo: 33.8 (#249), Wizardlm 70b: 31.4 (#285)

Coding benchmarks
BenchmarkGPT-4 TurboWizardlm 70b
LMArena Coding12681081
WeirdML18%—
BigCodeBench Instruct48.2%—
BigCodeBench Complete58.2%—
HumanEval+86.6%—
MBPP+73.3%—

Agentic & Tool Use Not comparable

GPT-4 Turbo: —, Wizardlm 70b: —

Agentic & Tool Use benchmarks
BenchmarkGPT-4 TurboWizardlm 70b
METR Time Horizons36.7%—

Reasoning Wizardlm 70b leads

GPT-4 Turbo: 15.3 (#317), Wizardlm 70b: 20.7 (#234)

Reasoning benchmarks
BenchmarkGPT-4 TurboWizardlm 70b
LMArena Hard Prompts12511079
SimpleBench25.1%—
Chess Puzzles6%—
DTBench61.6%—
LMCA9.8%—
Epoch Capabilities Index127.25—
ForecastBench59.4—

Math Wizardlm 70b leads

GPT-4 Turbo: 9.0 (#322), Wizardlm 70b: 32.2 (#218)

Math benchmarks
BenchmarkGPT-4 TurboWizardlm 70b
LMArena Math12721116
FrontierMath (Tiers 1-3)0.7%—
OTIS Mock AIME 2024-20256.7%—
MATH Level 546.7%—

Knowledge Not comparable

GPT-4 Turbo: 24.3 (#268), Wizardlm 70b: —

Knowledge benchmarks
BenchmarkGPT-4 TurboWizardlm 70b
GPQA Diamond46.6%—
Confabulations28.4%—
LMArena Expert1223—
MMLU81.3%—

Multimodal Not comparable

GPT-4 Turbo: 30.6 (#110), Wizardlm 70b: —

Multimodal benchmarks
BenchmarkGPT-4 TurboWizardlm 70b
LMArena Vision1090—

Multilingual GPT-4 Turbo leads

GPT-4 Turbo: 40.5 (#216), Wizardlm 70b: 29.6 (#265)

Multilingual benchmarks
BenchmarkGPT-4 TurboWizardlm 70b
LMArena Non-English12451078
LMArena Chinese12421052
LMArena German12591083
LMArena Russian12591155
LMArena French1276—
LMArena Japanese1194—
LMArena Korean1187—
LMArena Spanish1260—

Instruction Following GPT-4 Turbo leads

GPT-4 Turbo: 65.8 (#216), Wizardlm 70b: 56.3 (#273)

Instruction Following benchmarks
BenchmarkGPT-4 TurboWizardlm 70b
LMArena Instruction Following12491093

Long Context GPT-4 Turbo leads

GPT-4 Turbo: 38.0 (#206), Wizardlm 70b: 33.3 (#263)

Long Context benchmarks
BenchmarkGPT-4 TurboWizardlm 70b
LMArena Longer Query12541097

Writing & Preference GPT-4 Turbo leads

GPT-4 Turbo: 47.7 (#206), Wizardlm 70b: 34.8 (#269)

Writing & Preference benchmarks
BenchmarkGPT-4 TurboWizardlm 70b
LMArena Text12721120
LMArena Creative Writing12691149
LMArena Multi-Turn12671108

Frequently asked questions

Is GPT-4 Turbo better than Wizardlm 70b?

Wizardlm 70b is the stronger model overall, scoring 33.0 to 30.5 on the Noometry Index.

Is GPT-4 Turbo or Wizardlm 70b better for coding?

GPT-4 Turbo scores higher on coding benchmarks: 33.8 versus 31.4 in the Noometry coding category.

How many benchmarks do GPT-4 Turbo and Wizardlm 70b share?

12 benchmarks have published results for both models. GPT-4 Turbo has 36 scored results on Noometry and Wizardlm 70b has 12.

Related comparisons

Go deeper