Statistical Significance Testing in Second Language Research: Basic Problems and Suggestions for Reform. Issue 1 (June 2015)

• Record Type: Journal Article
• Authors: Norris, John M.; Norris, John M.; Ross, Steven J.; Schoonen, Rob
• Is Part Of: Language learning. Volume 65:Issue 1(2015)
• Page Start: 97
• Page End: 126
• Publication Date: 2015-06
• Subjects: Language and languages -- Periodicals; Language and languages -- Study and teaching -- Periodicals; Linguistics; 407
• DOI: 10.1111/lang.12114
• Languages: English
• ISSNs: 0023-8333

Abstract

<abstract abstract-type="main"> <title> <x xml:space="preserve">Abstract</x> </title> <p>Traditions of statistical significance testing in second language (L2) quantitative research are strongly entrenched in how researchers design studies, select analyses, and interpret results. However, statistical significance tests using <italic>p</italic> values are commonly misinterpreted by researchers, reviewers, readers, and others, leading to confusion regarding the actual findings of primary studies and critical challenges for the accumulation of meaningful knowledge about language learning research. This paper outlines the basic challenges of accurately calculating and interpreting statistical significance tests, explores common examples of incorrect interpretations in L2 research, and proposes strategies for resolving these problems.</p> </abstract>