Partially-automated individualized assessment of higher education mathematics. Issue 6 (2nd May 2022)

• Record Type: Journal Article
• Authors: Rowlett, Peter
• Is Part Of: International journal of mathematical education in science and technology. Volume 53:Issue 6(2022)
• Page Start: 1413
• Page End: 1434
• Publication Date: 2022-05-02
• Subjects: Partially-automated assessment -- assessment -- e-assessment -- computer-aided assessment -- skills; 97D60 -- 97U50; Mathematics -- Study and teaching -- Periodicals; Mathematics -- Periodicals; 510.07
• DOI: 10.1080/0020739X.2020.1822554
• Languages: English
• ISSNs: 0020-739X

Abstract

Abstract : A partially-automated method of assessment is proposed, in which automated question setting is used to generate individualized versions of a coursework assignment, which is completed by students and marked by hand. This is designed to be (a) comparable to a traditional written coursework assignment in validity, in that complex and open-ended tasks can be set with diverse submission formats that would not be suitable for written examination or automated marking; and, (b) comparable to e-assessment in terms of reduction of academic misconduct, with individualization acting as a barrier to copying and collusion. This method of assessment is implemented in practice. Evaluation focuses on expert second-marking, student feedback and analysis of marks, and aims to establish that the partially-automated method can be useful in practice. The partially-automated method proposed appears to be capable of adapting a coursework assignment to make it less sensitive to copying and collusion (and therefore more reliable) while maintaining its validity, though leading to reduced efficiency for the marker. This paper therefore contributes the introduction of a novel approach to assessment which offers a way to bring automated individualization to the assessment of higher order skills in higher education mathematics.