Using multi-channel data with multi-level modeling to assess in-game performance during gameplay with Crystal Island. (November 2017)

• Record Type: Journal Article
• Authors: Taub, Michelle; Mudrick, Nicholas V.; Azevedo, Roger; Millar, Garrett C.; Rowe, Jonathan; Lester, James
• Is Part Of: Computers in human behavior. Volume 76(2017)
• Page Start: 641
• Page End: 655
• Publication Date: 2017-11
• Subjects: Cognitive strategies -- Metacognitive monitoring -- Game-based learning environments -- Eye tracking -- Log files -- Self-regulated learning; Interactive computer systems -- Periodicals; Man-machine systems -- Periodicals; 004.019
• DOI: 10.1016/j.chb.2017.01.038
• Languages: English
• ISSNs: 0747-5632

Abstract

Abstract: Game-based learning environments (GBLEs) have been touted as the solution for failing educational outcomes. In this study, we address some of these major issues by using multi-level modeling with data from eye movements and log files to examine the cognitive and metacognitive self-regulatory processes used by 50 college students as they read books and completed the associated in-game assessments (concept matrices) while playing the Crystal Island game-based learning environment. Results revealed that participants who read fewer books in total, but read each of them more frequently, and who had low proportions of fixations on books and concept matrices exhibited the strongest performance. Results stress the importance of assessing quality vs. quantity during gameplay, such that it is important to read books in-depth (i.e., quality), compared to reading books once (i.e., quantity). Implications for these findings involve designing adaptive GBLEs that scaffold participants based on their trace data, such that we can model efficient behaviors that lead to successful performance. Highlights: Used multi-level modeling to assess performance on in-game assessments with Crystal Island . Better performance when reading fewer total books, but reading each book more frequently. Better performance with low proportions of fixations on book content and book concept matrices. Highest performance with fewer books and low proportions of fixations on books and matrices. Implications for designing GBLEs that model efficient behavior leading to greater performance.