Experiment on Cognitive Load of Gesture Interaction Based on Semiotics. Issue 1 (February 2020)

• Record Type: Journal Article
• Authors: Sun, Wei; Jin, Yudi; Wang, JinLong; Yang, Hanbing
• Is Part Of: IOP conference series. Volume 750:Issue 1(2020)
• Publication Date: 2020-02
• Subjects: Gesture Interaction -- Cognitive Load -- Information Theory; Materials science -- Periodicals; 620.1105
• DOI: 10.1088/1757-899X/750/1/012142
• Languages: English
• ISSNs: 1757-8981

Abstract

Abstract: Objective: To explore the amount of information contained in gesture symbols and its relationship with cognitive load, and to provide theoretical guidance for gesture interaction design based on semiotics. Methods: Firstly, a user-defined method was combined with oral analysis to collect gestures and establish a corresponding semantic knowledge base. Based on the knowledge base, the icon algebra theory is used to redesign the gesture symbols. Then through experiments combined with the NASA-TLX scale to measure the user's cognitive load, and through data analysis to explore the relationship between the amount of information contained in the gesture symbol and it. Conclusion: The amount of information contained in gesture symbols has a significant correlation with the user's cognitive load and response time. As the amount of gesture symbol information increases, the user's cognitive load and response time also increase accordingly. Based on this, a regression equation of user cognitive load and information amount of gesture symbols is established, which provides theoretical support for the design of gesture symbols based on semiotics.