The probability of probability and research truths. (15th February 2017)

• Record Type: Journal Article
• Authors: Fatovich, Daniel M; Phillips, Michael
• Is Part Of: Emergency medicine Australasia. Volume 29:Number 2(2017:Apr.)
• Page Start: 242
• Page End: 244
• Publication Date: 2017-02-15
• Subjects: medical reversal -- P‐value -- probability -- replication -- statistical significance; Emergency medicine -- Periodicals; Emergency medicine -- Australasia -- Periodicals; 616.025
• DOI: 10.1111/1742-6723.12740
• Languages: English
• ISSNs: 1742-6731

Abstract

Abstract: The foundation of much medical research rests on the statistical significance of the P ‐value, but we have fallen prey to the seductive certainty of significance. Other scientific disciplines work to a different standard. This may partly explain why medical reversal is an increasing phenomenon, whereby new studies (based on the 0.05 standard) overturn previous significant findings. This has generated a crisis in the rigour of evidence‐based medicine, as many people erroneously believe that a P < 0.05 means the treatment effect is clinically important. However, statistics are not facts about the world. Nor should they be based on an arbitrary threshold that arose for historical reasons. This arbitrary threshold encourages an unthinking automatic response that contributes to industry's influence on medical research. Examples from emergency medicine practice illustrate these themes. Study replication needs to be valued as much as discovery. Careful and thoughtful unbiased thinking about the results we do have is undervalued.