Knowledge benchmark

# BoolQ leaderboard

> BoolQ results for 23 AI models, led by Falcon-180B at 89%. What the benchmark measures, who runs it, and a source for every score.
- Canonical page: https://noometry.com/benchmarks/boolq
- Last updated: 2026-10-10
- Title: BoolQ Leaderboard (October 2026): Scores by Model | Noometry

As of October 2026, Falcon-180B has the highest published BoolQ score on Noometry at 89%, out of 23 models with results.

Last verified October 10, 2026

## About BoolQ

Naturally occurring yes/no questions about a passage.

- **Category:** [Knowledge](https://noometry.com/best/knowledge)
- **Introduced:** 2019
- **Format:** Yes/no
- **Unit:** Percent (random guessing ≈ 50%)
- **Official site:** [github.com](https://github.com/google-research-datasets/boolean-questions)

## Top 15 models

Top models on BoolQ

1.  Falcon-180B 89%
2.  GPT-4o mini 88.7%
3.  Llama 2-70B 88.6%
4.  Mistral 7B 87.4%
5.  GPT-3.5-turbo 87%
6.  Qwen-14B 86.2%
7.  Gemini 1.5 Flash (May 2024) 85.8%
8.  Gemma 2 9B 85.7%
9.  Phi-3.5-MoE 84.6%
10.  Llama 2-34B 83.7%
11.  Gemma 7B 83.2%
12.  Falcon-40B 83.1%
13.  Llama 3.1-8B 82.8%
14.  Mistral Nemo 82.5%
15.  Llama 2-13B 82.4%
16.  808284868890

Sponsored placements are available on pages like this one. [Advertise on Noometry](https://noometry.com/advertise)

## All results

BoolQ results by model
| # | Model | Provider | Score | Setting | Source | Date |
| --- | --- | --- | --- | --- | --- | --- |
| 1 | [Falcon-180B](https://noometry.com/models/falcon-180b) |  [![](/logos/tii.svg) Technology Innovation Institute](https://noometry.com/providers/tii) | 89% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 2 | [GPT-4o mini](https://noometry.com/models/gpt-4o-mini) | [OpenAI](https://noometry.com/providers/openai) | 88.7% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 3 | [Llama 2-70B](https://noometry.com/models/llama-2-70b) |  [![](/logos/meta.svg) Meta](https://noometry.com/providers/meta) | 88.6% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 4 | [Mistral 7B](https://noometry.com/models/mistral-7b) |  [![](/logos/mistral.svg) Mistral AI](https://noometry.com/providers/mistral) | 87.4% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 5 | [GPT-3.5-turbo](https://noometry.com/models/gpt-3-5-turbo) | [OpenAI](https://noometry.com/providers/openai) | 87% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 6 | [Qwen-14B](https://noometry.com/models/qwen-14b) |  [![](/logos/alibaba.svg) Alibaba (Qwen)](https://noometry.com/providers/alibaba) | 86.2% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 7 | [Gemini 1.5 Flash (May 2024)](https://noometry.com/models/gemini-1-5-flash) |  [![](/logos/google.svg) Google](https://noometry.com/providers/google) | 85.8% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 8 | [Gemma 2 9B](https://noometry.com/models/gemma-2-9b) |  [![](/logos/google.svg) Google](https://noometry.com/providers/google) | 85.7% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 9 | [Phi-3.5-MoE](https://noometry.com/models/phi-3-5-moe) |  [![](/logos/microsoft.svg) Microsoft](https://noometry.com/providers/microsoft) | 84.6% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 10 | [Llama 2-34B](https://noometry.com/models/llama-2-34b) |  [![](/logos/meta.svg) Meta](https://noometry.com/providers/meta) | 83.7% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 11 | [Gemma 7B](https://noometry.com/models/gemma-7b) |  [![](/logos/google.svg) Google](https://noometry.com/providers/google) | 83.2% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 12 | [Falcon-40B](https://noometry.com/models/falcon-40b) |  [![](/logos/tii.svg) Technology Innovation Institute](https://noometry.com/providers/tii) | 83.1% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 13 | [Llama 3.1-8B](https://noometry.com/models/llama-3-1-8b) |  [![](/logos/meta.svg) Meta](https://noometry.com/providers/meta) | 82.8% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 14 | [Mistral Nemo](https://noometry.com/models/mistral-nemo) |  [![](/logos/mistral.svg) Mistral AI](https://noometry.com/providers/mistral) | 82.5% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 15 | [Llama 2-13B](https://noometry.com/models/llama-2-13b) |  [![](/logos/meta.svg) Meta](https://noometry.com/providers/meta) | 82.4% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 16 | [Llama 13b](https://noometry.com/models/llama-13b) |  [![](/logos/meta.svg) Meta](https://noometry.com/providers/meta) | 78.7% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 17 | [Phi-3.5-mini](https://noometry.com/models/phi-3-5-mini) |  [![](/logos/microsoft.svg) Microsoft](https://noometry.com/providers/microsoft) | 78% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 18 | [Llama 2-7B](https://noometry.com/models/llama-2-7b) |  [![](/logos/meta.svg) Meta](https://noometry.com/providers/meta) | 77.9% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 19 | [Qwen-7B](https://noometry.com/models/qwen-7b) |  [![](/logos/alibaba.svg) Alibaba (Qwen)](https://noometry.com/providers/alibaba) | 76.4% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 20 | [Phi-1.5](https://noometry.com/models/phi-1-5) |  [![](/logos/microsoft.svg) Microsoft](https://noometry.com/providers/microsoft) | 75.8% | 5 | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 21 | [Falcon-7B](https://noometry.com/models/falcon-7b) |  [![](/logos/tii.svg) Technology Innovation Institute](https://noometry.com/providers/tii) | 75.3% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 22 | [Gemma 2B](https://noometry.com/models/gemma-2b) |  [![](/logos/google.svg) Google](https://noometry.com/providers/google) | 69.4% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |
| 23 | [Dolly 2.0-12b](https://noometry.com/models/dolly-2-0-12b) |  [![](/logos/databricks.svg) Databricks](https://noometry.com/providers/databricks) | 56.3% |  | [Epoch AI](https://epoch.ai/benchmarks) |  |

## Compare the leaders

-   [Falcon-180B vs GPT-4o mini](https://noometry.com/compare/falcon-180b-vs-gpt-4o-mini)
-   [Falcon-180B vs Llama 2-70B](https://noometry.com/compare/falcon-180b-vs-llama-2-70b)
-   [Falcon-180B vs Mistral 7B](https://noometry.com/compare/falcon-180b-vs-mistral-7b)
-   [Falcon-180B vs GPT-3.5-turbo](https://noometry.com/compare/falcon-180b-vs-gpt-3-5-turbo)
-   [GPT-4o mini vs Llama 2-70B](https://noometry.com/compare/gpt-4o-mini-vs-llama-2-70b)
-   [GPT-4o mini vs Mistral 7B](https://noometry.com/compare/gpt-4o-mini-vs-mistral-7b)

## Other knowledge benchmarks

-   [GPQA Diamond](https://noometry.com/benchmarks/gpqa-diamond)
-   [Humanity's Last Exam](https://noometry.com/benchmarks/hle)
-   [SimpleQA Verified](https://noometry.com/benchmarks/simpleqa-verified)
-   [MMLU-Pro](https://noometry.com/benchmarks/mmlu-pro)
-   [Confabulations](https://noometry.com/benchmarks/confabulations)
-   [Vectara Hallucination Rate](https://noometry.com/benchmarks/vectara-hallucination)
-   [LMArena Expert](https://noometry.com/benchmarks/arena-expert)
-   [GPQA (HELM)](https://noometry.com/benchmarks/helm-gpqa)
-   [ARC (AI2) Challenge](https://noometry.com/benchmarks/arc-challenge) (reference)
-   [MMLU](https://noometry.com/benchmarks/mmlu) (reference)
-   [OpenBookQA](https://noometry.com/benchmarks/openbookqa) (reference)
-   [TriviaQA](https://noometry.com/benchmarks/triviaqa) (reference)

## Frequently asked questions

### What does BoolQ measure?

Naturally occurring yes/no questions about a passage.

### Which model has the highest BoolQ score?

As of October 2026, Falcon-180B has the highest published BoolQ score on Noometry at 89%, out of 23 models with results.

### What is the best open-weight model on BoolQ?

Falcon-180B has the highest BoolQ accuracy among open-weight models at 89%, ranking 1 of 23 overall.

### Cite this page

Noometry. (2026). BoolQ leaderboard. Retrieved October 10, 2026, from https://noometry.com/benchmarks/boolq

Quote Noometry with a link back to this page. It is also available in [Markdown](https://noometry.com/md/benchmarks/boolq.md).
