Improving translation quality stability using Bayesian predictive adaptation. (November 2015)

• Record Type: Journal Article
• Authors: Sanchis-Trilles, Germán; Casacuberta, Francisco
• Is Part Of: Computer speech & language. Volume 34(2015)
• Page Start: 1
• Page End: 17
• Publication Date: 2015-11
• Subjects: Bayesian methods -- Adaptation -- Natural language processing -- Machine translation; Speech processing systems -- Periodicals; Automatic speech recognition -- Periodicals; Computers -- Periodicals; Linguistics -- Periodicals; Speech-Language Pathology -- Periodicals; Traitement automatique de la parole -- Périodiques; Reconnaissance automatique de la parole -- Périodiques; Automatic speech recognition; Speech processing systems; Electronic journals; Periodicals; 006.454
• DOI: 10.1016/j.csl.2015.03.001
• Languages: English
• ISSNs: 0885-2308

Abstract

Abstract : Highlights: Bayesian predictive adaptation (BPA) is presented for model adaptation in SMT. Results are presented for a standard adaptation task (JHU SummerWorkshop 2012). Comparison between different sampling strategies. In-depth analysis of stability of most common optimisation algorithms in SMT. Computational cost comparison among the methods presented. Abstract: We introduce a Bayesian approach for the adaptation of the log-linear weights present in state-of-the-art statistical machine translation systems. Typically, these weights are estimated by optimising a given translation quality criterion, taking only into account a certain set of development data (e.g., the adaptation data). In this article, we show that the Bayesian framework provides appropriate estimates of such weights in conditions where adaptation data is scarce. The theoretical framework is presented, alongside with a thorough experimentation and comparison with other weight estimation methods. We provide a comparison of different sampling strategies, including an effective heuristic strategy and a theoretically sound Markov chain Monte-Carlo algorithm. Experimental results show that Bayesian predictive adaptation (BPA) outperforms the re-estimation from scratch in conditions where adaptation data is scarce. Further analysis reveals that the improvements obtained are due to the greater stability of the estimation procedure. In addition, the proposed BPA framework has a much lower computational cost than raw re-estimation.