Enabling Seamless Access to Digital Graphical Contents for Visually Impaired Individuals via Semantic-Aware Processing. (15th November 2007)

• Record Type: Journal Article
• Authors: Wang, Zheshen; Xu, Xinyu; Li, Baoxin
• Other Names: Pun Thierry Academic Editor.
• Is Part Of: EURASIP journal on image and video processing. Volume 2007(2007)
• Publication Date: 2007-11-15
• Subjects: Image processing -- Digital techniques -- Periodicals; Digital video -- Periodicals; Traitement d'images; Vidéo numérique; Digital video; Image processing -- Digital techniques; Periodicals; Electronic journal; Electronic journals; 621.367
• DOI: 10.1155/2007/18019
• Languages: English
• ISSNs: 1687-5176

Abstract

Abstract : Vision is one of the main sources through which people obtain information from the world, but unfortunately, visually-impaired people are partially or completely deprived of this type of information. With the help of computer technologies, people with visual impairment can independently access digital textual information by using text-to-speech and text-to-Braille software. However, in general, there still exists a major barrier for people who are blind to access the graphical information independently in real-time without the help of sighted people. In this paper, we propose a novel multi-level and multi-modal approach aiming at addressing this challenging and practical problem, with the key idea being semantic-aware visual-to-tactile conversion through semantic image categorization and segmentation, and semantic-driven image simplification. An end-to-end prototype system was built based on the approach. We present the details of the approach and the system, report sample experimental results with realistic data, and compare our approach with current typical practice.