Assessing replicability of findings across two studies of multiple features. (11th June 2018)

• Record Type: Journal Article
• Authors: Bogomolov, Marina; Heller, Ruth
• Is Part Of: Biometrika. Volume 105:Number 3(2018:Sep.)
• Page Start: 505
• Page End: 516
• Publication Date: 2018-06-11
• Subjects: Adaptive procedure -- False discovery rate -- Familywise error rate -- Meta-analysis -- Multiple testing -- Replicability analysis; Biometry -- Periodicals; 570.1519505
• DOI: 10.1093/biomet/asy029
• Languages: English
• ISSNs: 0006-3444

Abstract

Summary : Replicability analysis aims to identify the overlapping signals across independent studies that examine the same features. For this purpose we develop hypothesis testing procedures that first select the promising features from each of two studies separately. Only those features selected in both studies are then tested. The proposed procedures have theoretical guarantees regarding their control of the familywise error rate or false discovery rate on the replicability claims. They can also be used for signal discovery in each study separately, with the desired error control. Their power for detecting truly replicable findings is compared to alternatives. We illustrate the procedures on behavioural genetics data.