What is TruthfulQA?

What is TruthfulQA?

TruthfulQA is a benchmark designed to measure the truthfulness of language models when generating answers to questions. It consists of 817 questions across 38 categories, including health, law, finance, and politics. The benchmark was created to address the issue of language models sometimes generating false answers that mimic popular misconceptions or incorrect beliefs held by humans.

The questions in TruthfulQA are crafted to be adversarial, meaning they are intended to test for weaknesses in a model's ability to produce truthful responses. The benchmark is particularly focused on imitative falsehoods, which are less likely to be covered by existing answering benchmarks and are a concern as models scale up and reduce perplexity on the training distribution.

TruthfulQA evaluates models in a zero-shot setting, where no tuning is allowed, and includes two tasks: generation, where the model generates a 1-3 sentence answer, and a multiple-choice task. The benchmark also introduced new automatic metrics for evaluating truthfulness and informativeness based on fine-tuning GPT-4 on a dataset of gold-standard human evaluations.

Current correction: The benchmark's automatic truthfulness and informativeness metrics used evaluators fine-tuned from GPT-3, not GPT-4.

TruthfulQA evaluates models in a zero-shot setting, where no tuning is allowed, and includes two tasks: generation, where the model generates a 1-3 sentence answer, and a multiple-choice task. The benchmark also introduced new automatic metrics for evaluating truthfulness and informativeness based on fine-tuning GPT-3 on a dataset of gold-standard human evaluations.

The creation of TruthfulQA is based on the premise that simply scaling up models may not necessarily improve their truthfulness, and that models must avoid generating false answers learned from imitating human texts. The benchmark aims to foster advancements in fields like law, science, and engineering by promoting the development of more truthful language models.

TruthfulQA Leaderboard (January 2024)

Current provenance caveat: The historical table above did not identify its TruthfulQA task, metric, prompt, evaluator, source revision, or evaluation date beyond the page label. It is preserved as legacy content and must not be treated as a reproducible or current leaderboard.

In the original 2021 benchmark-author evaluation, GPT-3 175B with the “helpful” prompt was truthful on 58% of open-ended generation questions, compared with 94% for the human baseline (benchmark summary, paper). These are historical results from the authors' original zero-shot generation protocol, not a current leaderboard and not directly comparable with the unspecified table above.

In the original 2021 benchmark-author evaluation, GPT-3 175B with the “helpful” prompt was truthful on 58% of open-ended generation questions, compared with 94% for the human baseline (benchmark summary, paper). These are historical results from the authors' original zero-shot generation protocol, not a current leaderboard.

How does TruthfulQA work?

TruthfulQA evaluates the truthfulness of language models by presenting 817 adversarial questions across 38 categories such as health, law, finance, and politics. These questions are designed to challenge models with scenarios where humans might hold incorrect beliefs or misconceptions.

TruthfulQA is used in two main tasks: generation and multiple-choice. In the generation task, given a question, the model is required to generate a 1-2 sentence answer. The primary objective is overall truthfulness, expressed as the percentage of the model's answers that are true. Since this can be gamed with a model that responds "I have no comment" to every question, the secondary objective is the percentage of the model's answers that are informative.

The benchmark uses automated metrics for evaluating truthfulness and informativeness. These metrics are based on fine-tuning GPT-3 on a dataset of gold-standard human evaluations. A model called "GPT-judge" is used, which is a GPT-3-6.7B model fine-tuned to classify answers to the questions in TruthfulQA as true or false.

The benchmark also includes a multiple-choice task, which provides a quick and reproducible way to assess models. However, the specifics of how the multiple-choice task is used in TruthfulQA are not detailed in the search results.

Current protocol context: TruthfulQA now appears in several distinct evaluation settings. MC1 asks a model to identify one true answer among false alternatives, while MC2 measures the probability assigned across sets of true and false answers. In January 2025, the benchmark authors introduced a binary-choice version that pairs one correct answer with one incorrect answer. They recommend this format for future evaluations because the earlier multi-answer format can expose “odd-one-out” shortcuts unrelated to truthfulness.

It's important to note that the largest models were generally found to be the least truthful. This contrasts with other NLP tasks, where performance improves with model size. This suggests that scaling up models alone is less promising for improving truthfulness than fine-tuning them.

Current interpretation: TruthfulQA does not have an official live leaderboard. Open-ended generation, MC1, MC2, and binary-choice scores use different tasks and metrics, so their values and rankings are not interchangeable. The original 2021 evaluation found that the largest tested models were generally the least truthful, while the authors' 2025 update reports that this inverse-scaling pattern does not continue cleanly among newer models. Every result should name its protocol, scoring method, prompt, and evaluation date.

Canonical protocol and scaling interpretation

TruthfulQA now appears in several distinct evaluation settings. MC1 asks a model to identify one true answer among false alternatives, while MC2 measures the probability assigned across sets of true and false answers. In January 2025, the benchmark authors introduced a binary-choice version that pairs one correct answer with one incorrect answer. They recommend this format for future evaluations because the earlier multi-answer format can expose “odd-one-out” shortcuts unrelated to truthfulness.

TruthfulQA does not have an official live leaderboard. Open-ended generation, MC1, MC2, and binary-choice scores use different tasks and metrics, so their values and rankings are not interchangeable. Any reported result should name the protocol, scoring method, prompt, and evaluation date instead of presenting one model as the benchmark's universal current leader.

The original 2021 evaluation found that the largest tested models were generally the least truthful, suggesting that model scale helped reproduce misconceptions in the training data. The authors' 2025 update reports that this inverse-scaling pattern does not continue cleanly among newer models, further underscoring the need to qualify results by benchmark version and protocol.

What are some future directions for TruthfulQA research?

TruthfulQA is a benchmark designed to measure the truthfulness of language models in generating answers to questions. The benchmark comprises 817 questions that span 38 categories, including health, law, finance, and politics. The questions are crafted in such a way that some humans would answer falsely due to a false belief or misconception. To perform well, models must avoid generating false answers learned from imitating human texts.

The future directions for TruthfulQA research could include:

1. Improving Factual Reliability — One of the key challenges with large language models (LLMs) is their factual unreliability. Future research could focus on developing techniques to improve the factual reliability of these models. This could involve self-training, fact-checking, and other methods to ensure the accuracy of the information generated by the models.

2. Addressing Bias and Toxicity — LLMs have been criticized for their potential to generate biased or toxic content. Future research could focus on developing methods to mitigate these issues, making the models safer and more reliable.

3. Fine-Tuning Models — The TruthfulQA research suggests that scaling up models alone is less promising for improving truthfulness than fine-tuning them. Future research could focus on exploring different fine-tuning techniques and training objectives to improve the truthfulness of the models.

4. Expanding the Benchmark — The current TruthfulQA benchmark focuses on short-form question-answering in a zero-shot setting. Future research could expand this benchmark to cover other tasks, such as long-form generation or interactive settings.

5. Developing More Truthful Models — The best model tested on the TruthfulQA benchmark was truthful on 58% of questions, while human performance was 94%. Future research could focus on developing models that are more truthful, aiming to close this gap.

6. Understanding Scaling Trends — The TruthfulQA research found that larger models were generally less truthful. Future research could focus on understanding these scaling trends and exploring ways to improve the truthfulness of larger models.

Protocol-qualified future directions

5. Developing More Truthful Models — The original gap between GPT-3 175B with the helpful prompt (58% truthful) and the human baseline (94% truthful) demonstrated substantial room for improvement. Newer results should be compared only within the same TruthfulQA protocol and scoring method.

6. Understanding Scaling Trends — The original TruthfulQA research found inverse scaling within the model families it tested, while the authors' 2025 update found that this pattern did not continue cleanly among newer models. Future research could investigate which training and evaluation choices influence these trends.

Current context for items 5–6: The 58% result specifically belongs to GPT-3 175B with the helpful prompt under the original generation protocol, versus the 94% human baseline. Newer results require the same protocol and scoring method for comparison. The authors' 2025 update found that the original inverse-scaling pattern did not continue cleanly among newer models.

Protocol-qualified item 5: The original gap between GPT-3 175B with the helpful prompt (58% truthful) and the human baseline (94% truthful) demonstrated substantial room for improvement. Newer results should be compared only within the same TruthfulQA protocol and scoring method.

Protocol-qualified item 6: The original TruthfulQA research found inverse scaling within the model families it tested, while the authors' 2025 update found that this pattern did not continue cleanly among newer models. Future research could investigate which training and evaluation choices influence these trends.

7. Exploring the Impact of Training Data — There is speculation that training on certain types of data, such as code data, could improve the performance of LLMs on tasks like TruthfulQA. This is an area that could be explored in future research.

These future directions could help to address some of the current limitations of LLMs and make them more useful and reliable for a wide range of applications.

What are some limitations of TruthfulQA benchmark?

The TruthfulQA benchmark, designed to measure the truthfulness of language models in generating answers to questions, has several limitations:

1. Limited Scope — The TruthfulQA benchmark focuses on short-form question-answering in a zero-shot setting. It does not cover other tasks such as long-form generation or interactive settings.

2. Adversarial Design — The questions in TruthfulQA were designed to be "adversarial" in the sense of testing for a weakness. This design might not reflect the full range of real-world scenarios where language models are used.

3. Data Contamination — There could be issues of "data contamination", where the data used to train or evaluate a model includes misleading or irrelevant information. This can lead to skewed or unreliable benchmark outcomes.

4. Lack of Specialized Knowledge Testing — The questions in TruthfulQA stress diversity without testing specialized knowledge. This means models that perform well on the TruthfulQA benchmark won't necessarily answer as truthfully in scenarios that require specialized knowledge.

5. Potential for Misinterpretation — The benchmark's approach to determining truthfulness could potentially be misinterpreted. For instance, a model could earn a perfect score by either expressing uncertainty for every question or by always agreeing with the consensus view, neither of which necessarily reflect truthfulness.

6. Limited Use Case Representation — The benchmark may not adequately represent all use cases for language models. For example, a low score on TruthfulQA might be desirable for certain applications, such as role-playing, where the ability to generate creative or non-literal responses could be valuable.

These limitations suggest that while TruthfulQA is a valuable tool for assessing the truthfulness of language models, it should be used in conjunction with other methods and benchmarks to provide a more comprehensive evaluation.