Automatic topic detection on Chinese essays: a technology enhanced approach to facilitating formative use of summative assessment. (25th October 2021)

• Record Type: Journal Article
• Authors: Poon, Leonard K.M.; Ng, Wing Shui; Cheng, Gary
• Is Part Of: International journal of mobile learning and organisation. Volume 15:Number 4(2021)
• Page Start: 374
• Page End: 391
• Publication Date: 2021-10-25
• Subjects: topic detection -- hierarchical latent tree analysis -- formative use of summative assessment -- technology enhanced assessment -- Chinese essays; Mobile communication systems -- Periodicals; Communication in organizations -- Periodicals; Organizational learning -- Periodicals; Mobile communication systems in education -- Periodicals; 371.33
• Languages: English
• ISSNs: 1746-725X

Abstract

Essay writing is an important form of assessment. It is typically used as summative assessment and may not have some of the major benefits of formative assessment. Although there are considerations of formative use of summative assessment, such use remains limited in practice. It is because of the difficulty in presenting the results and the large amount of effort required. In this paper, we propose to use an automatic topic detection method, named hierarchical latent tree analysis, for analysing students' essays. The method can identify topics in the essays and organise those topics in a hierarchy with multiple levels of granularity. It can possibly facilitate formative use of summative assessment by addressing the main reasons prohibiting such use. We present the empirical results of the method using the 54 Chinese essays written by students in an undergraduate course. We further discuss and demonstrate how the method can facilitate formative use of the essays.