Using augmented reality with speech input for non-native children's language learning. Issue 134 (February 2020)

• Record Type: Journal Article
• Authors: Che Dalim, Che Samihah; Sunar, Mohd Shahrizal; Dey, Arindam; Billinghurst, Mark
• Is Part Of: International journal of human-computer studies. Issue 134(2020)
• Page Start: 44
• Page End: 64
• Publication Date: 2020-02
• Subjects: Human-computer interface -- Improving classroom teaching -- Interactive learning environments -- Teaching/learning strategies; Human-machine systems -- Periodicals; Systems engineering -- Periodicals; Human engineering -- Periodicals; Human engineering; Human-machine systems; Systems engineering; Periodicals; Electronic journals; 004.019
• DOI: 10.1016/j.ijhcs.2019.10.002
• Languages: English
• ISSNs: 1071-5819

Abstract

Highlights: Augmented reality could be associated with theories of second language acquisition. Using speech input for the interaction, effective learning experience is predicted. 120 non-native children participated: learning gain and enjoyment measured. Results show higher learning gain of abstract words, children highly motivated. Speech-enabled augmented reality can be used as foreign language learning tool. Abstract: Augmented Reality (AR) offers an enhanced learning environment which could potentially influence children's experience and knowledge gain during the language learning process. Teaching English or other foreign languages to children with different native language can be difficult and requires an effective strategy to avoid boredom and detachment from the learning activities. With the growing numbers of AR education applications and the increasing pervasiveness of speech recognition, we are keen to understand how these technologies benefit non-native young children in learning English. In this paper, we explore children's experience in terms of knowledge gain and enjoyment when learning through a combination of AR and speech recognition technologies. We developed a prototype AR interface called TeachAR, and ran two experiments to investigate how effective the combination of AR and speech recognition was towards the learning of 1) English terms for color and shapes, and 2) English words for spatial relationships. We found encouraging results by creating a novel teaching strategy using these two technologies, not only in terms of increase in knowledge gain and enjoyment when compared with traditional strategy but also enables young children to finish the certain task faster and easier.