Towards safe and collaborative aerodrome operations: Assessing shared situational awareness for adverse weather detection with EEG-enabled Bayesian neural networks. (August 2022)

• Record Type: Journal Article
• Authors: Yiu, Cho Yin; Ng, Kam K.H.; Li, Xinyu; Zhang, Xiaoge; Li, Qinbiao; Lam, Hok Sam; Chong, Man Ho
• Is Part Of: Advanced engineering informatics. Volume 53(2022)
• Publication Date: 2022-08
• Subjects: Bayesian neural networks -- Aerodrome operations -- Adverse weather conditions -- Mutual information -- Shared situational awareness -- Explainable artificial intelligence; Computer-aided engineering -- Periodicals; Engineering -- Data processing -- Periodicals; 620.00285
• DOI: 10.1016/j.aei.2022.101698
• Languages: English
• ISSNs: 1474-0346

Abstract

Highlights: A human-centred approach to detect adverse weather concerning human performance. Bayesian neural networks were trained with EEG data. Mutual information was used as an indicator of shared situational awareness. SHAP values explain the latent mental patterns and formulate novel knowledge. Abstract: Teams formulated by aviation professionals are essential in maintaining a safe and efficient aerodrome environment. Nonetheless, the shared situational awareness between the flight crews under adverse weather conditions might be impaired. This research aims to evaluate the impact of a proposed enhancement in communication protocol on cognitive workload and develop a human-centred classification model to identify hazardous meteorological conditions. Thirty groups of subjects completed four post-landing taxiing tasks under two visibility conditions (CAVOK/CAT IIIA) while two different communication protocols (presence/absence of turning direction information) were adopted by the air traffic control officer (ATCOs). Electroencephalography (EEG) and the NASA Task Load Index were respectively used to reflect the pilot's mental state and to evaluate the pilot's mental workload subjectively. Results indicated that impaired visibility increases the subjective workload significantly, while the inclusion of turning direction information in the ATCO's instruction would not significantly intensify their cognitive workload. Mutual information was used to quantitatively assess the shared situational awareness between the pilot flying and the pilot monitoring. Finally, this research proposes a human-centred approach to identify potentially hazardous weather conditions from EEG power spectral densities with Bayesian neural networks (BNN). The classification model has outperformed other baseline algorithms with an accuracy of 66.5%, an F1 score of 61.4%, and an area under the ROC of 0.749. Using the concept of explainable AI with Shapley Additive Explanations (SHAP) values, the exploration of latent mental patterns formulates novel knowledge to gain insights into the vital physiological indicators of the pilots in response to different scenarios from the BNN model. In the long term, the model facilitates the decision regarding the necessity of providing automation and decision-making aids to pilots.