Interrogating the construct of communicative competence in language assessment contexts: What the non-language specialist can tell us. (November 2017)

• Record Type: Journal Article
• Authors: Elder, Catherine; McNamara, Tim; Kim, Hyejeong; Pill, John; Sato, Takanori
• Is Part Of: Language & communication. Volume 57(2017:Nov.)
• Page Start: 14
• Page End: 21
• Publication Date: 2017-11
• Subjects: Communicative competence -- Construct definition -- Indigenous assessment -- Language testing -- Lay perspective -- Testing language for specific purposes; Communication -- Periodicals; Linguistics -- Periodicals; Communication -- Periodicals; Linguistics -- Periodicals; Communication -- Périodiques; Linguistique -- Périodiques; Communication; Linguistics; Periodicals; Electronic journals; 405
• DOI: 10.1016/j.langcom.2016.12.005
• Languages: English
• ISSNs: 0271-5309

Abstract

Abstract: Models of communicative competence in a second language invoked in defining the construct of widely used tests of communicative language ability have drawn largely on the work of language specialists. The risk of exclusive reliance on language expertise to conceptualize, design and administer language tests is that test scores may carry meanings that are misaligned with the values of non-language specialists, that is, those without language expertise but perhaps with expert knowledge in the domain of concern. Neglect of the perspective of lay (i.e., non-linguistic) judges on language and communication is a serious validity concern, since they are the ultimate arbiters of what matters for effective communication in the relevant context of language use. The paper reports on three research studies exploring the validity of rating scales used to assess speaking performance on a number of high-stakes English-language tests developed for professional or general proficiency assessment purposes in Korea, Australia, China, and the UK. Drawing on Jacoby and McNamara's (1999) notion of "indigenous assessment", each project attempted to identify the values underlying non-language specialists' judgements of spoken communication as they rated test performance or participated in focus-group workshops where they viewed and commented on video- or audio-recorded samples of performance in the relevant real-world domain. The findings of these studies raise the question of whether language can or should be assessed as object independently of the content which it conveys or without regard for the goal and context of the communication. The studies' findings also cast doubt on the notion that the native speaker should always serve as benchmark for judging communicative effectiveness, especially with tests of language for specific purposes, where native speakers and second-language learners alike may lack the requisite skills for the kind of effective interaction demanded by the context. Highlights: We consider the scope of current conceptualizations of communicative competence in tests of spoken language. We present studies illustrating aspects of performance underrepresented in traditional criteria for speaking tests. We propose the greater use of non-language specialists' views to determine assessment criteria.