Multi-text multi-modal reading processes and comprehension. (February 2021)

• Record Type: Journal Article
• Authors: Cromley, Jennifer G.; Kunze, Andrea J.; Dane, Aygül Parpucu
• Is Part Of: Learning and instruction. Volume 71(2021)
• Publication Date: 2021-02
• Subjects: Multiple text -- Comprehension -- Multimedia -- Learning strategies -- Integration; Learning -- Periodicals; Teaching -- Periodicals; Apprentissage -- Périodiques; Enseignement -- Périodiques; Learning; Teaching; Periodicals; Electronic journals; 370.1
• DOI: 10.1016/j.learninstruc.2020.101413
• Languages: English
• ISSNs: 0959-4752

Abstract

Abstract: Learners frequently access multiple, illustrated texts on a single topic, but this kind of multi-text, multi-modal comprehension has been rarely studied. Undergraduates were presented with two sets of biology materials on shared topics, including both texts and captioned illustrations. Process data, including think-alouds and screen recordings of participants' attendance to different foci, were recorded. Both intra-textual (e.g., T1, T1) and inter-textual (e.g., T1, T2) navigation sequences and switches from texts to diagrams (e.g, T1, D1) were recorded and examined in relation to comprehension performance. Patterns in participants' navigation across texts and illustrations were identified. Students who were higher-performing in the sample exhibited more intra-textual switches, suggestive of forming a page-specific mental model. For one text, inter-textual text-to-diagram switches were negatively associated with high-level strategies, and thus negatively associated with performance; inter-textual text-to-diagram switches might have indicated confusion. Participants appeared to be in the early stages of learning a complex set of MTMM comprehension skills. Highlights: 30 students were given multiple non-contradictory illustrated texts to read and integrate. Students provided an oral explanation and drawing of the learned concept. Higher performers engaged in more intra-text switches. Some inter-textual navigation was negatively associated with comprehension.