"We Didn't Catch That!" Using Voice Text Input on a Mixed Reality Headset in Noisy Environments. (December 2020)

• Record Type: Journal Article
• Authors: Derby, Jessyca L.; Rickel, Emily A.; Harris, Kelly J.; Lovell, Jade A.; Chaparro, Barbara S.
• Is Part Of: Proceedings of the Human Factors and Ergonomics Society ... Annual Meeting. Volume 64:Part 1(2020)
• Page Start: 2102
• Page End: 2106
• Publication Date: 2020-12
• Subjects: Human engineering -- Congresses; 620.8205
• DOI: 10.1177/1071181320641509
• Languages: English
• ISSNs: 1541-9312

Abstract

The Microsoft HoloLens, a mixed reality head-mounted display (HMD), has been demonstrated in domains such as medicine, engineering, and manufacturing. In order to interact with the device, voice input may be required. Given this range of environments, it is necessary to understand the impact of noise on voice dictation speed and accuracy. In this study, we evaluated the dictation feature of the HoloLens through speed (WPM), accuracy (WER), perceived workload, and perceived usability at three different noise levels: 40 dB, 55 dB, and 70 dB. No differences were found across noise levels in speed (67-75 WPM), or perceived workload. Accuracy and perceived usability worsened in the 70 dB noise condition. Only 37.5% of participants were able to successfully dictate in the 70 dB condition. This study shows that if the HoloLens is to be accepted in environments with high noise levels, improvements to dictation need to be made.