Reasons for relating representations when reading digital multimodal science information. (August 2018)

• Record Type: Journal Article
• Authors: Sivle, Anders D; Uppstad, Per H
• Other Names: Wildfeuer Janina guest-editor.; Adami Elisabetta guest-editor.; Boeriis Morten guest-editor.; Ravelli Louise J guest-editor.; Veloso Francisco OD guest-editor.
• Is Part Of: Visual communication. Volume 17:Number 3(2018)
• Page Start: 313
• Page End: 336
• Publication Date: 2018-08
• Subjects: exploratory -- eye-tracking -- integration -- multimodality -- multiple representations -- reading path; Visual communication -- Periodicals; Popular culture -- Periodicals; Art and society -- Periodicals; 302.222
• DOI: 10.1177/1470357218763330
• Languages: English
• ISSNs: 1470-3572

Abstract

This exploratory study examined 16 participants' reasons for relating representations when reading online information that presented weather forecasts comprising a variety of representations. They were told to advise a friend, who was planning to paint the exterior of his house, based on the online information. The participants' multimodal reading was tracked with a SMI RED (50 Hz) eye-tracker, and their reasons for relating representations were investigated through a retrospective think-aloud protocol cued by the recording of the individual's reading behaviour and a stand-alone interview. In line with expected behaviour, results suggest that decision-making processes influenced the construction of reading paths. More interestingly, results showed that the participants' reasons for making transitions between representations were to control and compare information. The discussion focuses on this study's unique contribution in terms of new conjectures for future research.