II.
Responsibility overview
Reference · liveresponsibility:a-b-test-integrity
A/B test integrity overview
Ensure statistical rigor of A/B experiments — proper randomization, sample size calculation, multiple comparison correction, and preventing peeking bias. Guard against p-hacking and premature conclusions.
Attributes
displayName
A/B test integrity
cadence
continuous
description
Ensure statistical rigor of A/B experiments — proper randomization,
sample size calculation, multiple comparison correction, and preventing
peeking bias. Guard against p-hacking and premature conclusions.
Outgoing edges
held_by3
- role:data-scientist·RoleData Scientist
- role:growth-engineer·RoleGrowth Engineer
- role:conversion-rate-optimizer·RoleConversion Rate Optimizer
requires_expertise2
- skill-area:experiment-design-AB-testing·SkillAreaExperiment Design & A/B Testing
- skill-area:statistical-analysis·SkillAreaStatistical Analysis
Incoming edges
holds_responsibility2
- role:recommendation-engineer·RoleRecommendation Engineer
- role:conversion-rate-optimizer·RoleConversion Rate Optimizer
triggers_responsibility1
- workflow:a-b-test-lifecycle·WorkflowA/B Test Lifecycle