Find the errors, get the better: Enhancing machine translation via word confidence estimation. (7th March 2017)

• Record Type: Journal Article
• Authors: LUONG, NGOC-QUANG; BESACIER, LAURENT; LECOUTEUX, BENJAMIN
• Is Part Of: Natural language engineering. Volume 23:Part 4(2017)
• Page Start: 617
• Page End: 639
• Publication Date: 2017-03-07
• Subjects: Natural language processing (Computer science) -- Periodicals; Software engineering -- Periodicals; 006.35
• DOI: 10.1017/S1351324917000080
• Languages: English
• ISSNs: 1351-3249

Abstract

Abstract: This paper presents two novel ideas of improving the Machine Translation (MT) quality by applying the word-level quality prediction for the second pass of decoding. In this manner, the word scores estimated by word confidence estimation systems help to reconsider the MT hypotheses for selecting a better candidate rather than accepting the current sub-optimal one. In the first attempt, the selection scope is limited to the MT N -best list, in which our proposed re-ranking features are combined with those of the decoder for re-scoring. Then, the search space is enlarged over the entire search graph, storing many more hypotheses generated during the first pass of decoding. Over all paths containing words of the N -best list, we propose an algorithm to strengthen or weaken them depending on the estimated word quality. In both methods, the highest score candidate after the search becomes the official translation. The results obtained show that both approaches advance the MT quality over the one-pass baseline, and the search graph re-decoding achieves more gains (in BLEU score) than N -best List Re-ranking method.