A review of driver fatigue detection and its advances on the use of RGB-D camera and deep learning. (November 2022)

• Record Type: Journal Article
• Authors: Liu, Fan; Chen, Delong; Zhou, Jun; Xu, Feng
• Is Part Of: Engineering applications of artificial intelligence. Volume 116(2022)
• Publication Date: 2022-11
• Subjects: Intelligent transportation system -- Driver fatigue detection -- Abnormal behavior detection -- Information fusion -- RGB-D -- Deep learning -- Computer vision -- Convolutional neural network; Engineering -- Data processing -- Periodicals; Artificial intelligence -- Periodicals; Expert systems (Computer science) -- Periodicals; Ingénierie -- Informatique -- Périodiques; Intelligence artificielle -- Périodiques; Systèmes experts (Informatique) -- Périodiques; Artificial intelligence; Engineering -- Data processing; Expert systems (Computer science); Periodicals; 620.00285
• DOI: 10.1016/j.engappai.2022.105399
• Languages: English
• ISSNs: 0952-1976

Abstract

Abstract: Driver fatigue is an essential reason for traffic accidents, which poses a severe threat to people's lives and property. In this review, we summarize the latest research findings and analyze the developmental trends of driver fatigue detection. Firstly, we analyze and discuss four types of different fatigue detection technologies based on driver physiological signals, behavior features, vehicle running features, and information fusion, respectively. Then, we focus on RGB-D camera and deep learning which are two state-of-the-art solutions in this field. Finally, we present the work on integration of RGB-D camera and deep learning, where Generative Adversarial Networks and multi-channel schemes are utilized to enhance the performance. We conducted experiments to show that the fatigue features extracted by Convolutional Neural Networks are superior to traditional handcrafted ones while single features cannot guarantee robustness. Moreover, the latent fatigue features extracted by deep learning methods have been demonstrated to be effective for fatigue detection.