Hypothesis Testing in the Real World. (August 2017)

• Record Type: Journal Article
• Authors: Miller, Jeff
• Is Part Of: Educational and psychological measurement. Volume 77:Number 4(2017:Aug.)
• Page Start: 663
• Page End: 672
• Publication Date: 2017-08
• Subjects: common sense logic -- hypothesis testing -- statistical methods; Educational tests and measurements -- Periodicals; Psychological tests -- Periodicals; 151.205
• DOI: 10.1177/0013164416667984
• Languages: English
• ISSNs: 0013-1644

Abstract

Critics of null hypothesis significance testing suggest that (a) its basic logic is invalid and (b) it addresses a question that is of no interest. In contrast to (a), I argue that the underlying logic of hypothesis testing is actually extremely straightforward and compelling. To substantiate that, I present examples showing that hypothesis testing logic is routinely used in everyday life. These same examples also refute (b) by showing circumstances in which the logic of hypothesis testing addresses a question of prime interest. Null hypothesis significance testing may sometimes be misunderstood or misapplied, but these problems should be addressed by improved education.