Improving evidence-based assessment of players using serious games. (July 2021)

• Record Type: Journal Article
• Authors: Alonso-Fernández, Cristina; Freire, Manuel; Martínez-Ortiz, Iván; Fernández-Manjón, Baltasar
• Is Part Of: Telematics and informatics. Volume 60(2021)
• Publication Date: 2021-07
• Subjects: Data science applications in education -- Evaluation methodologies -- Games -- Teaching/learning strategies; Telecommunication -- Periodicals; Computer networks -- Periodicals; Télécommunications -- Périodiques; Réseaux d'ordinateurs -- Périodiques; 384
• DOI: 10.1016/j.tele.2021.101583
• Languages: English
• ISSNs: 0736-5853

Abstract

Highlights: Techniques to assess serious games players make little use of interaction data. We propose an evidence-based approach to assess players from their interactions. Approach tested in two case studies, combining questionnaires and prediction models. Simplifying large scale deployment and application of serious games. Abstract: Serious games are highly interactive systems which can therefore capture large amounts of player interaction data. This data can be analyzed to provide a deep insight into the effect of the game on its players. However, traditional techniques to assess players of serious games make little use of interaction data, relying instead on costly external questionnaires. We propose an evidence-based process to improve the assessment of players by using their interaction data. The process first combines player interaction data and traditional questionnaires to derive and refine game learning analytics variables, which can then be used to predict the effects of the game on its players. Once the game is validated, and suitable prediction models have been built, the prediction models can be used in large-scale deployments to assess players solely based on their interactions, without the need for external questionnaires. We briefly describe two case studies where this combination of traditional questionnaires and data mining techniques has been successfully applied. The evidence-based assessment process proposed radically simplifies the deployment and application of serious games in real class settings.