Drawing on indigenous criteria for more authentic assessment in a specific-purpose language test: Health professionals interacting with patients. (April 2016)

• Record Type: Journal Article
• Authors: Pill, John
• Other Names: Elder Catherine guest-editor.
• Is Part Of: Language testing. Volume 33:Number 2(2016:Apr.)
• Page Start: 175
• Page End: 193
• Publication Date: 2016-04
• Subjects: Health professional–patient interaction -- healthcare communication -- indigenous assessment criteria -- language proficiency -- LSP testing -- Occupational English Test; Language and languages -- Ability testing -- Periodicals; Language and languages -- Examinations -- Periodicals; 407.6
• DOI: 10.1177/0265532215607400
• Languages: English
• ISSNs: 0265-5322

Abstract

The indigenous assessment practices (Jacoby & McNamara, 1999) in selected health professions were investigated to inform a review of the scope of assessment in the speaking sub-test of a specific-purpose English language test for health professionals, the Occupational English Test (OET). The assessment criteria in current use on the test represent a generalized view of language and are concerned withOverall Communicative Effectiveness, Fluency, Intelligibility, Appropriateness of Language, andResources of Grammar and Expression . The research study focused on healthcare consultations between trainee health professionals and patients. Educators and supervisors observed these interactions and subsequently provided feedback on trainees' performances. The assumption was that, in their comments, educators would give information pertinent to trainees' acculturation to the expectations and behaviours of the profession, that is, to "what matters" to practitioners. Thematic analysis was undertaken to establish the aspects of performance that matter to health professionals in these contexts. Data for each profession were coded independently. Clear similarities across the professions became apparent as themes emerged. An exploratory conceptual model of what health professionals value in the consultation was developed, comprising three focal areas: foundation, performance and goals of the consultation. Findings from the analysis provided an empirical basis for the generation and definition of two additional, professionally relevant criteria for use in the OET speaking sub-test –Clinician Engagement andManagement of Interaction – and of a checklist of performance indicators to be used to train assessors in applying the new criteria. This process of developing, through close analysis of domain experts' commentary, test criteria that are potentially more authentic to the target language use situation is novel and may be replicated effectively in other specific-purpose language testing contexts.