Does adding video and subtitles to an audio lesson facilitate its comprehension?. (February 2022)
- Record Type:
- Journal Article
- Title:
- Does adding video and subtitles to an audio lesson facilitate its comprehension?. (February 2022)
- Main Title:
- Does adding video and subtitles to an audio lesson facilitate its comprehension?
- Authors:
- Zheng, Yueyuan
Ye, Xinchen
Hsiao, Janet H. - Abstract:
- Abstract: We examined whether adding video and subtitles to an audio lesson facilitates its comprehension and whether the comprehension depends on participants' cognitive abilities, including working memory and executive functions, and where they looked during video viewing. Participants received lessons consisting of statements of facts under four conditions: audio-only, audio with verbatim subtitles, audio with relevant video, and audio with both subtitles and video. Comprehension was assessed as the accuracy in answering multiple-choice questions for content memory. We found that subtitles facilitated comprehension whereas video did not. In addition, comprehension of audio lessons with video depended on participants' cognitive abilities and eye movement pattern: a more centralized (looking mainly at the screen center) eye movement pattern predicted better comprehension as opposed to a distributed pattern (with distributed regions of interest). Thus, whether video facilitates comprehension of audio lessons depends on both learners' cognitive abilities and where they look during video viewing. Highlights: Verbatim subtitles facilitate comprehension of audio lessons whereas video did not. Comprehension of audio lessons with video depended on learners' eye gaze pattern. A more centralized eye movement pattern predicted better comprehension.
- Is Part Of:
- Learning and instruction. Volume 77(2022)
- Journal:
- Learning and instruction
- Issue:
- Volume 77(2022)
- Issue Display:
- Volume 77, Issue 2022 (2022)
- Year:
- 2022
- Volume:
- 77
- Issue:
- 2022
- Issue Sort Value:
- 2022-0077-2022-0000
- Page Start:
- Page End:
- Publication Date:
- 2022-02
- Subjects:
- Multimedia learning -- Eye movement -- Hidden markov model -- EMHMM
Learning -- Periodicals
Teaching -- Periodicals
Apprentissage -- Périodiques
Enseignement -- Périodiques
Learning
Teaching
Periodicals
Electronic journals
370.1 - Journal URLs:
- http://www.sciencedirect.com/science/journal/09594752 ↗
http://www.elsevier.com/journals ↗ - DOI:
- 10.1016/j.learninstruc.2021.101542 ↗
- Languages:
- English
- ISSNs:
- 0959-4752
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - 5179.325890
British Library DSC - BLDSS-3PM
British Library HMNTS - ELD Digital store - Ingest File:
- 24986.xml