Hearing and Seeing Tone Through Color: An Efficacy Study of Web‐Based, Multimodal Chinese Tone Perception Training. Issue 4 (11th July 2017)

• Record Type: Journal Article
• Authors: Godfroid, Aline; Lin, Chin‐Hsi; Ryu, Catherine
• Is Part Of: Language learning. Volume 67:Issue 4(2017)
• Page Start: 819
• Page End: 857
• Publication Date: 2017-07-11
• Subjects: audiovisual perception -- color -- multimedia learning -- tone -- Chinese as a second language; Language and languages -- Periodicals; Language and languages -- Study and teaching -- Periodicals; Linguistics; 407
• DOI: 10.1111/lang.12246
• Languages: English
• ISSNs: 0023-8333

Abstract

Abstract: Multimodal approaches have been shown to be effective for many learning tasks. In this study, we compared the effectiveness of five multimodal methods for second language (L2) Mandarin tone perception training: three single‐cue methods (number, pitch contour, color) and two dual‐cue methods (color and number, color and pitch contour). A total of 303 true novice learners of L2 Mandarin (native speakers of English) completed a 3‐week online training program. Results from pretests as well as immediate and delayed posttests indicated that multimodal training aided L2 learners' tone perception, with a small, practical advantage for pitch contours and numbers over color coding. Dual‐cue methods did not yield better learning than single‐cue training. Thus, the additive benefits of multimodal input (i.e., auditory and visual) did not extend to instruction featuring doubled visual input (i.e., visual and visual). We argue for embedding color in visuals in a way that helps make abstract information concrete.