ORMA: A strategy to reduce Psychology's replication problems. (January 2023)

• Record Type: Journal Article
• Authors: Howard, George S.; Maxwell, Scott E.
• Is Part Of: New ideas in psychology. Volume 68(2023)
• Publication Date: 2023-01
• Subjects: Replication crisis -- Meta-analysis -- Publication bias -- File drawer; Psychology -- Philosophy -- Periodicals; Psychology -- Methodology -- Periodicals; Psychology -- Periodicals; Psychologie -- Philosophie -- Périodiques; Psychologie -- Méthodologie -- Périodiques; Psychology -- Methodology; Psychology -- Philosophy; Electronic journals; Periodicals; 150
• DOI: 10.1016/j.newideapsych.2022.100991
• Languages: English
• ISSNs: 0732-118X

Abstract

Abstract: Because of their historical reliance upon null hypothesis statistical tests (NHST), the human sciences have developed a number of potentially problematic research literatures. While aware of the file drawer effect since the 1970s, scientists have been largely unsuccessful at addressing its pernicious effects. Because significant results have a greater likelihood of being published than do nonsignificant effects, many of our research literatures might currently be constructed upon a series of Type I errors and inflated effect sizes. A method (called Original Replication of Meta-Analyses or ORMA) has recently been developed for identifying problematic research literatures and offering a method to address the problems due to publication bias. Philosophers of science have long argued that a chief reason for science's preeminence as a source of knowledge rests in its ability to self-correct. Researchers in the human sciences are now able to empirically test their research literatures to ascertain which are in need of repair. The use of ORMA serves to lessen the problems that led to the recent calls for bans on significant/nonsignificant statistics in human science research. ORMA will also improve psychology's ability to successfully replicate its research findings. Highlights: Research literatures in the human sciences are problematic. Psychology and other fields are in the midst of a replication crisis. A method for identifying problematic research literatures (called ORMA) has recently been developed. ORMA has the potential to address the ongoing replication crisis in psychology and other disciplines. ORMA helps fulfill science's essential goal to self-correct.