Promoting musical instrument learning in virtual reality environment: Effects of embodiment and visual cues. (June 2023)

• Record Type: Journal Article
• Authors: Yu, Shufan; Liu, Qingtang; Johnson-Glenberg, Mina C.; Han, Miaomiao; Ma, Jingjing; Ba, Shen; Wu, Linjing
• Is Part Of: Computers & education. Volume 198(2023)
• Publication Date: 2023-06
• Subjects: Augmented and virtual reality -- Applications in subject areas -- Human-computer interface -- Media in education -- Simulations; Education -- Data processing -- Periodicals; Education -- Periodicals; Computers -- Periodicals; Computer-Assisted Instruction -- Periodicals; Éducation -- Informatique -- Périodiques; Electronic journals; 370.285
• DOI: 10.1016/j.compedu.2023.104764
• Languages: English
• ISSNs: 0360-1315

Abstract

Abstract: While virtual reality (VR) provides a great potential for musical instrument learning, little attention has been paid to the instructional design in creating a VR musical instrument. Previous research has suggested that high embodied interaction or added visual cues (e.g., distinctive colors, flashing areas) on VR-based musical instrument may aid students' learning. In this study, we investigated the feasibility and efficacy of the embodied design (low and high level of embodiment; LoEmb and HiEmb) and visual cues (low and high level of visual cues; LoViz and HiViz) on students' musical instrument learning. Four corresponding virtual Chinese dulcimers ( Yangqin ) were thereby designed. A sample of 112 university students participated in our study, and they were randomly assigned into the four conditions (LoEmb & LoViz, LoEmb & HiViz, HiEmb & LoViz, and HiEmb & HiViz). Results showed that the LoEmb design benefited students' completion rate, the HiViz improved students' playing rhythmic accuracy. Both LoEmb and HiViz decreased students' playing errors and improved their overall performance. Moreover, we found that the HiViz and HiEmb designs had a combined effect on reducing students' cognitive load and improving the instructional efficiency of learning material. These findings collectively reveal that the design of VR learning materials should carefully consider the trade-off between the level of embodiment and visual cues. Highlights: The effect of embodiment and visual cues was investigated in musical instrument learning. The LoEmb design benefited students' musical playing completion rate, and the HiViz facilitated students' playing rhythm. Both LoEmb and HiViz decreased students' playing errors and improved their overall performance. HiViz and HiEmb design can reduce students' cognitive load and improve the instructional efficiency of learning material. Designing a VR learning material should carefully consider the trade-off between the level of embodiment and visual cues.