P‐Hacking, P‐Curves, and the PSM–Performance Relationship: Is There Evidential Value?. (20th October 2020)

• Record Type: Journal Article
• Authors: Vogel, Dominik; Homberg, Fabian
• Is Part Of: Public administration review. Volume 81:Number 2(2021)
• Page Start: 191
• Page End: 204
• Publication Date: 2020-10-20
• Subjects: United States -- Politics and government -- Periodicals; Public administration -- Periodicals; 350
• DOI: 10.1111/puar.13273
• Languages: English
• ISSNs: 0033-3352

Abstract

Abstract: Recent developments in the social sciences have demonstrated that we cannot uncritically aggregate the published research on a particular effect to conclude about its presence or absence. Instead, questionable research practices such as p‐ hacking (conducting additional analyses or collecting new data to obtain significant results) and selective publication of significant results can produce a body of published research that misleads readers even if it contains many significant results. It is, therefore, necessary to assess the evidential value of the research on a certain effect; that is, one must rule out that it is the result of questionable research practices. We introduce the p‐curve method to public administration research and apply it to the research on the relationship between public service motivation (PSM) and individual performance, to demonstrate how the evidential value of a body of published research can be assessed. We find that this particular literature contains evidential value.