A general interactive framework for false discovery rate control under structural constraints. (31st July 2020)

• Record Type: Journal Article
• Authors: Lei, Lihua; Ramdas, Aaditya; Fithian, William
• Is Part Of: Biometrika. Volume 108:Number 2(2021)
• Page Start: 253
• Page End: 267
• Publication Date: 2020-07-31
• Subjects: Accumulation test -- Data carving -- False discovery rate -- Interactive multiple testing -- Knockoff -- Masking; Biometry -- Periodicals; 570.1519505
• DOI: 10.1093/biomet/asaa064
• Languages: English
• ISSNs: 0006-3444

Abstract

Summary: We propose a general framework based on selectively traversed accumulation rules for interactive multiple testing with generic structural constraints on the rejection set. It combines accumulation tests from ordered multiple testing with data-carving ideas from post-selection inference, allowing highly flexible adaptation to generic structural information. Our procedure defines an interactive protocol for gradually pruning a candidate rejection set, beginning with the set of all hypotheses and shrinking the set with each step. By restricting the information at each step via a technique we call masking, our protocol enables interaction while controlling the false discovery rate in finite samples for any data-adaptive update rule that the analyst may choose. We suggest update rules for a variety of applications with complex structural constraints, demonstrate that selectively traversed accumulation rules perform well in problems ranging from convex region detection to false discovery rate control on directed acyclic graphs, and show how to extend the framework to regression problems where knockoff statistics are available in lieu of $p$ -values.