Fitting MD analysis in an argument-based validity framework for writing assessment: Explanation and generalization inferences for the ECPE. (April 2020)

• Record Type: Journal Article
• Authors: Yan, Xun; Staples, Shelley
• Is Part Of: Language testing. Volume 37:Number 2(2020)
• Page Start: 189
• Page End: 214
• Publication Date: 2020-04
• Subjects: Argument-based framework -- corpus linguistics -- lexico-grammatical features -- multidimensional analysis -- validity -- writing assessment; Language and languages -- Ability testing -- Periodicals; Language and languages -- Examinations -- Periodicals; 407.6
• DOI: 10.1177/0265532219876226
• Languages: English
• ISSNs: 0265-5322

Abstract

The argument-based approach to validity (Kane, 2013) focuses on two steps: (1) making claims about the proposed interpretation and use of test scores as a coherent, interpretive argument; and (2) evaluating those claims based on theoretical and empirical evidence related to test performances and scores. This paper discusses the role of multidimensional (MD) analysis (Biber, 1988), a corpus analytic approach to examining linguistic and discourse characteristics of language performance, in an argument-based validation framework for writing assessment. We propose a set of warrants, assumptions and evidence for inferential steps pertaining to investigations of performance characteristics in language assessments. Then, we illustrate how MD analysis can provide evidence for generalization and explanation inferences through a case study that examines lexico-grammatical features of writing performances on the Examination for the Certification of Proficiency in English (ECPE).