Optical laser microphone for human-robot interaction: speech recognition in extremely noisy service environments. (19th March 2022)

• Record Type: Journal Article
• Authors: Fukumori, Takahiro; Cai, Chengkai; Zhang, Yutao; El Hafi, Lotfi; Hagiwara, Yoshinobu; Nishiura, Takanobu; Taniguchi, Tadahiro
• Is Part Of: Advanced robotics. Volume 36:Number 5/6(2022)
• Page Start: 304
• Page End: 317
• Publication Date: 2022-03-19
• Subjects: Optical laser microphone -- speech recognition -- domestic robot -- laser Doppler vibrometer; Robotics -- Periodicals; Robotics -- Japan -- Periodicals; Robotics; Japan; Periodicals; 629.89205
• DOI: 10.1080/01691864.2021.2023629
• Languages: English
• ISSNs: 0169-1864

Abstract

Abstract : Domestic robots are often required to understand spoken commands in noisy environments, including service appliances' operating sounds. Most conventional domestic robots use electret condenser microphones (ECMs) to record the sound. However, the ECMs are known to be sensitive to the noise in the direction of sound arrival. The laser Doppler vibrometer (LDV), which has been widely used in the research field of measurement, has the potential to work as a new speech-input device to solve this problem. The aim of this paper is to investigate the effectiveness of using the LDV as an optical laser microphone for human-robot interaction in extremely noisy service environments. Our robot irradiates an object near a speaker with a laser and measures the vibration of the object to record the sound. We conducted three experiments to assess the performance of speech recognition using the optical laser microphone in various settings and showed stable performance in extremely noisy conditions compared with a conventional ECM. GRAPHICAL ABSTRACT: UF0001