Multimodal alignment in telecollaboration: A methodological exploration. (November 2022)

• Record Type: Journal Article
• Authors: Cappellini, Marco; Holt, Benjamin; Hsu, Yu-Yin
• Is Part Of: System. Volume 110(2022)
• Publication Date: 2022-11
• Subjects: Telecollaboration -- Virtual exchange -- Interactive alignment -- Lexical alignment -- Structural alignment -- Facial expression alignment; Language and languages -- Study and teaching -- Periodicals; Langage et langues -- Étude et enseignement -- Périodiques; Electronic journals; 407
• DOI: 10.1016/j.system.2022.102931
• Languages: English
• ISSNs: 0346-251X

Abstract

Abstract: This paper presents an analysis of interactive alignment (Pickering & Garrod, 2004 ) from a multimodal perspective (Guichon & Tellier, 2017 ) in two telecollaborative settings. We propose a framework to analyze alignment during desktop videoconferencing in its multimodality, including lexical and structural alignment (Michel & Cappellini, 2019 ) as well as multimodal alignment involving facial expressions. We analyze two datasets coming from two different models of telecollaboration. The first one is based on the Français en (première) ligne model (Develotte et al., 2007 ) which puts future foreign language teachers in contact with learners of that language. The second one is based on the teletandem model (Telles, 2009 ), where students of two different mother tongues interact to help each other use and learn the other's language. The paper makes explicit a semi-automatic procedure to study alignment multimodally. We tested our method on a dataset that is composed of two 1-h sessions. Results show that in desktop videoconferencing-based telecollaboration, facial expression alignment is a pivotal component of multimodal alignment.