II.
TestSet overview
Reference · livetest-set:gpqa-diamond
GPQA Diamond overview
GPQA Diamond is the hardest subset of the Graduate-level Google-Proof Q&A (GPQA) benchmark introduced by Rein et al., 2023.
Attributes
displayName
GPQA Diamond
benchmarkId
caseCount
198
releasedAt
2023-11-29
composition
The "diamond" subset of GPQA — 198 graduate-level questions in
biology, chemistry, and physics, written and validated by domain
experts. Diamond is the hardest tier; experts (PhD students in the
same field) achieve ~65% accuracy.
homepageUrl
description
GPQA Diamond is the hardest subset of the Graduate-level Google-Proof
Q&A (GPQA) benchmark introduced by Rein et al., 2023.
Outgoing edges
None.
Incoming edges
uses_test_set1
- benchmark:gpqa·BenchmarkGPQA