Hand Gesture and Mathematics Learning: Lessons From an Avatar. (29th April 2016)

• Record Type: Journal Article
• Authors: Cook, Susan Wagner; Friedman, Howard S.; Duggan, Katherine A.; Cui, Jian; Popescu, Voicu
• Is Part Of: Cognitive science. Volume 41:Number 2(2017)
• Page Start: 518
• Page End: 535
• Publication Date: 2016-04-29
• Subjects: Gesture -- Learning -- Mathematics -- Animated pedagogical agent -- Nonverbal behavior -- Cognitive development -- Instruction; Cognition -- Periodicals; Psycholinguistics -- Periodicals; Artificial intelligence -- Periodicals; 153.05
• DOI: 10.1111/cogs.12344
• Languages: English
• ISSNs: 0364-0213

Abstract

Abstract: A beneficial effect of gesture on learning has been demonstrated in multiple domains, including mathematics, science, and foreign language vocabulary. However, because gesture is known to co‐vary with other non‐verbal behaviors, including eye gaze and prosody along with face, lip, and body movements, it is possible the beneficial effect of gesture is instead attributable to these other behaviors. We used a computer‐generated animated pedagogical agent to control both verbal and non‐verbal behavior. Children viewed lessons on mathematical equivalence in which an avatar either gestured or did not gesture, while eye gaze, head position, and lip movements remained identical across gesture conditions. Children who observed the gesturing avatar learned more, and they solved problems more quickly. Moreover, those children who learned were more likely to transfer and generalize their knowledge. These findings provide converging evidence that gesture facilitates math learning, and they reveal the potential for using technology to study non‐verbal behavior in controlled experiments.