displayName
TruthfulQA — multiple-choice
benchmarkId
caseCount
817
releasedAt
2021-09-08
composition
The 817-question multiple-choice split of TruthfulQA, covering
38 categories of common human misconceptions. Used in MC1 (single
correct answer) and MC2 (normalized probability mass over all
correct answers) scoring modes.
homepageUrl
https://github.com/sylinrl/TruthfulQA
description
The MC split is the standard reported number for vendor
leaderboards on TruthfulQA.