Augmented Reality Brain–Computer Interface with Spatial Awareness. Issue 12 (2nd August 2022)

• Record Type: Journal Article
• Authors: Sugino, Masato; Mori, Fumina; Tanaka, Mai; Kotani, Kiyoshi; Jimbo, Yasuhiko
• Is Part Of: IEEJ transactions on electrical and electronic engineering. Volume 17:Issue 12(2022)
• Page Start: 1820
• Page End: 1822
• Publication Date: 2022-08-02
• Subjects: augmented reality -- brain–computer interface -- object detection -- SSVEP -- spatial awareness; Electrical engineering -- Periodicals; Electronics -- Periodicals; 621.3
• DOI: 10.1002/tee.23692
• Languages: English
• ISSNs: 1931-4973

Abstract

Abstract : Brain–computer interfaces (BCIs) measure brain waves to assist communication and operation of equipment. However, for application of BCIs in real life settings, portability and environmental adaptability are crucial. For BCIs using visual stimuli, portability can be achieved by using augmented reality (AR) with head‐mounted displays, but prior placement of markers in the physical space is required for displaying appropriate choices. In this study, we demonstrate an environmentally adaptable AR‐BCI that uses machine learning and depth sensors. The virtual marker that the user is focusing on through the transmissive AR display is estimated from the user's electroencephalograms (EEG), and preliminary accuracy exceeds chance level. These results suggest that the use of machine learning and AR head‐mounted displays can increase the adaptability of BCIs. © 2022 Institute of Electrical Engineers of Japan. Published by Wiley Periodicals LLC.