Anomalies and False Rejections. (17th February 2020)

• Record Type: Journal Article
• Authors: Chordia, Tarun; Goyal, Amit; Saretto, Alessio
• Editors: Karolyi, Andrew
• Is Part Of: Review of financial studies. Volume 33:Number 5(2020)
• Page Start: 2134
• Page End: 2179
• Publication Date: 2020-02-17
• Subjects: C12 -- G12; Finance -- United States -- Periodicals; Finance -- Periodicals; 332
• DOI: 10.1093/rfs/hhaa018
• Languages: English
• ISSNs: 0893-9454

Abstract

Abstract: We use information from over 2 million trading strategies randomly generated using real data and from strategies that survive the publication process to infer the statistical properties of the set of strategies that could have been studied by researchers. Using this set, we compute $t$ -statistic thresholds that control for multiple hypothesis testing, when searching for anomalies, at 3.8 and 3.4 for time-series and cross-sectional regressions, respectively. We estimate the expected proportion of false rejections that researchers would produce if they failed to account for multiple hypothesis testing to be about 45%.