Transfer learning based on lexical constraint mechanism in low-resource machine translation. (May 2022)

• Record Type: Journal Article
• Authors: Jiang, Hao; Zhang, Chao; Xin, Zhihui; Huang, Xiaoqiao; Li, Chengli; Tai, Yonghang
• Is Part Of: Computers & electrical engineering. Volume 100(2022)
• Publication Date: 2022-05
• Subjects: Transfer learning -- Lexical constraint -- Low-resource machine translation -- Data augmentation; Computer engineering -- Periodicals; Electrical engineering -- Periodicals; Electrical engineering -- Data processing -- Periodicals; Ordinateurs -- Conception et construction -- Périodiques; Électrotechnique -- Périodiques; Électrotechnique -- Informatique -- Périodiques; Computer engineering; Electrical engineering; Electrical engineering -- Data processing; Periodicals; Electronic journals; 621.302854
• DOI: 10.1016/j.compeleceng.2022.107856
• Languages: English
• ISSNs: 0045-7906

Abstract

Highlights: Solutions for low resource machine translation tasks. Application of lexical constraint mechanism to domain matching problems of machine translation tasks. Application of transfer learning to vocabulary constraint models. Integrated use of multiple machine translation evaluation mechanisms. Abstract: With the fast development of artificial intelligence (AI) technology, machine translation has become a mainstream field of natural language processing. The low-resource language machine translation tasks have become an essential question. However, traditional machine translation systems usually rely on large amounts of high-quality parallel training data. In terms of this question, data augmentation and transfer learning technique in AI domain have become an effective solution for dealing with low-resource language machine translation. Besides, to better solve the domain mismatch problem of machine translation tasks, leveraging lexical constraint mechanism is a significant measure. We presented an approach which applies the transfer learning techniques for the lexical constraint model in this paper. For the existed problem of the transfer learning and lexical constraint technologies, some improved methods are proposed. We choose the appropriate beam search algorithm for lexical constraint measure and investigate the proper way for transferring parameters across two machine translation models. Besides, we will also investigate the compelling data pre-processing steps to process the low-resource corpus and quote various objective evaluation mechanisms to estimate the performance of our pattern better. The comprehensive experiments and results in the paper demonstrate that our method toward low-resource machine translation tasks is effective. Graphical abstract: Image, graphical abstract