Automatic sentence stress feedback for non-native English learners. (January 2017)

• Record Type: Journal Article
• Authors: Lee, Gary Geunbae; Lee, Ho-Young; Song, Jieun; Kim, Byeongchang; Kang, Sechun; Lee, Jinsik; Hwang, Hyosung
• Is Part Of: Computer speech & language. Volume 41(2016)
• Page Start: 29
• Page End: 42
• Publication Date: 2017-01
• Subjects: Sentence stress -- Sentence stress feedback system -- Stress prediction model -- Stress detection model -- Stress feedback provision model -- CALL; Speech processing systems -- Periodicals; Automatic speech recognition -- Periodicals; Computers -- Periodicals; Linguistics -- Periodicals; Speech-Language Pathology -- Periodicals; Traitement automatique de la parole -- Périodiques; Reconnaissance automatique de la parole -- Périodiques; Automatic speech recognition; Speech processing systems; Electronic journals; Periodicals; 006.454
• DOI: 10.1016/j.csl.2016.04.003
• Languages: English
• ISSNs: 0885-2308

Abstract

Highlights: The proposed sentence stress feedback system consists of stress prediction, detection and feedback provision models. The accuracy of the stress prediction and detection models was 96.6% and 84.1% respectively. The stress feedback provision model provides non-native learners with sentence stress errors. Any sentence can be used for practice in the proposed system. Students trained with this system improved their accentedness and rhythm significantly more than those in the control group. Abstract: This paper proposes a sentence stress feedback system in which sentence stress prediction, detection, and feedback provision models are combined. This system provides non-native learners with feedback on sentence stress errors so that they can improve their English rhythm and fluency in a self-study setting. The sentence stress feedback system was devised to predict and detect the sentence stress of any practice sentence. The accuracy of the prediction and detection models was 96.6% and 84.1%, respectively. The stress feedback provision model offers positive or negative stress feedback for each spoken word by comparing the probability of the predicted stress pattern with that of the detected stress pattern. In an experiment that evaluated the educational effect of the proposed system incorporated in our CALL system, significant improvements in accentedness and rhythm were seen with the students who trained with our system but not with those in the control group.