Evaluating English language learners' conversations: Man vs. Machine. Issue 4 (4th May 2019)

• Record Type: Journal Article
• Authors: Forsyth, Carol M.; Luce, Christine; Zapata-Rivera, Diego; Jackson, G. Tanner; Evanini, Keelan; So, Youngsoon
• Is Part Of: Computer assisted language learning. Volume 32:Issue 4(2019)
• Page Start: 398
• Page End: 417
• Publication Date: 2019-05-04
• Subjects: English language learning -- conversation-based assessment -- formative assessment; Language and languages -- Computer-assisted instruction -- Periodicals; 418.00285
• DOI: 10.1080/09588221.2018.1517126
• Languages: English
• ISSNs: 0958-8221

Abstract

Abstract: This study investigated a new conversation-based assessment for English language learners. In this assessment, students converse with animated agents in natural language conversations to assess various aspects of English language learning. In a between subjects design, 31 students ( N = 31) were asked questions by either the newly created system or human interviewers. Results revealed that there was no difference in answers in regards to impacting the constructs under investigation. However, there were other differences including higher word count and potentially more complex language usage when speaking to a human. Furthermore, students liked interacting with the system. These results suggest that the newly created system can assess students' English capabilities comparably to human interviewers and implementing such a formative assessment is feasible.