Study on eye-gaze input interface based on deep learning using images obtained by multiple cameras. (July 2022)

• Record Type: Journal Article
• Authors: Mu, Shenglin; Shibata, Satoru; Chiu, Kuo-chun; Yamamoto, Tomonori; Liu, Tung-kuan
• Is Part Of: Computers & electrical engineering. Volume 101(2022)
• Publication Date: 2022-07
• Subjects: Communication assistance -- Eye-gaze input interface -- Image processing -- Convolutional neural network -- Deep learning; Computer engineering -- Periodicals; Electrical engineering -- Periodicals; Electrical engineering -- Data processing -- Periodicals; Ordinateurs -- Conception et construction -- Périodiques; Électrotechnique -- Périodiques; Électrotechnique -- Informatique -- Périodiques; Computer engineering; Electrical engineering; Electrical engineering -- Data processing; Periodicals; Electronic journals; 621.302854
• DOI: 10.1016/j.compeleceng.2022.108040
• Languages: English
• ISSNs: 0045-7906

Abstract

Abstract: In this research, an eye-gaze input interface with features of high accuracy, simplicity, low cost, and almost no possibilities in causing illness or damages to user's eyes is proposed using commercial web cameras in natural light environment. The system employs the Haar-like function in OpenCV library to detect the user's face and eyes. Following the preprocessing of grayscale and histogram equalization, the processed eye images of the user are applied to train the proposed Convolutional Neural Network (CNN) for the estimation of user's eye-gaze direction. Six types of camera layouts have been investigated in this research. The images from different camera layouts are merged and processed for the CNN training to estimate eye-gaze direction. According to experimental study using the proposed method, the improvement in accuracy confirmed. Meanwhile, the layout with highest accuracy and effectiveness among the proposed six layouts was confirmed.