Image-Based Tactile Emojis: Improved Interpretation of Message Intention and Subtle Nuance for Visually Impaired Individuals. (2nd January 2020)
- Record Type:
- Journal Article
- Title:
- Image-Based Tactile Emojis: Improved Interpretation of Message Intention and Subtle Nuance for Visually Impaired Individuals. (2nd January 2020)
- Main Title:
- Image-Based Tactile Emojis: Improved Interpretation of Message Intention and Subtle Nuance for Visually Impaired Individuals
- Authors:
- Choi, Yuri
Hyun, Kyung Hoon
Lee, Ji-Hyun - Abstract:
- Abstract : To enhance missing nonverbal cues in computer-mediated communication using text, those who can see often use emojis or emoticons. Although emojis for the sighted have transformed throughout the years to animated forms and added sound effects, emojis for visually impaired people remain underdeveloped. This study tested how tactile emojis based on visual imagery combined with the Braille system can enhance clarity in the computer-mediated communication environment for those with visual impairments. Results of this study confirmed three things: Visually impaired subjects were able to connect emotional emojis to the emotion they represented without any prior guidance, image-based (picture-based) and non-image-based (abstraction-based) tactile emoji were equally learnable, and the clarity of intended meaning was improved when an emoji was used with text (Braille). Thirty visually impaired subjects were able to match an average of 67% of emotions without prior guidance, and three of the four subjects who matched perfectly both before and after guidance were congenitally blind. The subjects had the most trouble discriminating the facial feature of "fear" between "sadness" or "surprised" for they shared similar traits. After guidance, the image-based tactile design elicited an average of 81% correct answers, whereas the non-image-based tactile design elicited an average of 37%, showing that the image-based tactile design was more effective for learning the meaning ofAbstract : To enhance missing nonverbal cues in computer-mediated communication using text, those who can see often use emojis or emoticons. Although emojis for the sighted have transformed throughout the years to animated forms and added sound effects, emojis for visually impaired people remain underdeveloped. This study tested how tactile emojis based on visual imagery combined with the Braille system can enhance clarity in the computer-mediated communication environment for those with visual impairments. Results of this study confirmed three things: Visually impaired subjects were able to connect emotional emojis to the emotion they represented without any prior guidance, image-based (picture-based) and non-image-based (abstraction-based) tactile emoji were equally learnable, and the clarity of intended meaning was improved when an emoji was used with text (Braille). Thirty visually impaired subjects were able to match an average of 67% of emotions without prior guidance, and three of the four subjects who matched perfectly both before and after guidance were congenitally blind. The subjects had the most trouble discriminating the facial feature of "fear" between "sadness" or "surprised" for they shared similar traits. After guidance, the image-based tactile design elicited an average of 81% correct answers, whereas the non-image-based tactile design elicited an average of 37%, showing that the image-based tactile design was more effective for learning the meaning of emojis. The clarity of the sentence was also improved. This study shows that image-based tactile emojis can improve the texting experience of visually impaired individuals to a level where they can communicate subtle emotional cues through tactile imagery. This advance could minimize the service gap between sighted and visually impaired people and offer a much more abundant computer-mediated communication environment for visually impaired individuals. … (more)
- Is Part Of:
- Human-computer interaction. Volume 35:Isuse 1(2020)
- Journal:
- Human-computer interaction
- Issue:
- Volume 35:Isuse 1(2020)
- Issue Display:
- Volume 35, Issue 1 (2020)
- Year:
- 2020
- Volume:
- 35
- Issue:
- 1
- Issue Sort Value:
- 2020-0035-0001-0000
- Page Start:
- 40
- Page End:
- 69
- Publication Date:
- 2020-01-02
- Subjects:
- System design -- Periodicals
Computers -- Psychological aspects -- Periodicals
Human-machine systems -- Periodicals
004.019 - Journal URLs:
- http://www.tandfonline.com/toc/hhci20/current ↗
http://www.informaworld.com/smpp/title~db=jour~content=t775653648~tab=issueslist ↗
http://www.tandfonline.com/ ↗
http://firstsearch.oclc.org ↗
http://www.leaonline.com/loi/hci ↗ - DOI:
- 10.1080/07370024.2017.1324305 ↗
- Languages:
- English
- ISSNs:
- 0737-0024
- Deposit Type:
- Legaldeposit
- View Content:
- Available online (eLD content is only available in our Reading Rooms) ↗
- Physical Locations:
- British Library DSC - 4336.043450
British Library DSC - BLDSS-3PM
British Library HMNTS - ELD Digital store - Ingest File:
- 12064.xml