II.
Benchmark overview
Reference · livebenchmark:bias-bench
BBQ (Bias Benchmark for QA) overview
BBQ (Parrish et al., NYU 2022) is a bias benchmark for question answering covering nine social dimensions (age, disability, gender, nationality, physical appearance, race/ethnicity, religion, socioeconomic status, sexual orientation), measuring stereotype bias under both ambiguous and disambiguated contexts.
Attributes
displayName
BBQ (Bias Benchmark for QA)
homepageUrl
kind
model-only
targetsKind
ModelVersion
description
BBQ (Parrish et al., NYU 2022) is a bias benchmark for question
answering covering nine social dimensions (age, disability, gender,
nationality, physical appearance, race/ethnicity, religion,
socioeconomic status, sexual orientation), measuring stereotype
bias under both ambiguous and disambiguated contexts.
Outgoing edges
applies_to1
- domain:social-sciences·DomainSocial Sciences
covers1
- skill-area:safety-redteaming·SkillAreaSafety Red-Teaming
Incoming edges
None.