Search and learning for unsupervised text generation. Issue 4 (5th December 2022)

• Record Type: Journal Article
• Authors: Mou, Lili
• Is Part Of: AI magazine. Volume 43:Issue 4(2022)
• Page Start: 344
• Page End: 352
• Publication Date: 2022-12-05
• Subjects: Artificial intelligence -- Periodicals; Artificial intelligence -- Computer programs -- Periodicals; System design -- Periodicals; Artificial intelligence -- Technological innovations -- Periodicals; Artificial intelligence -- Industrial applications -- Periodicals; Artificial intelligence -- Educational applications -- Periodicals; Intelligence artificielle -- Périodiques; Intelligence artificielle -- Logiciels -- Périodiques; Conception de systèmes -- Périodiques; Intelligence artificielle -- Innovations -- Périodiques; Intelligence artificielle -- Applications industrielles -- Périodiques; Intelligence artificielle -- Applications en éducation -- Périodiques; Artificial intelligence; Artificial intelligence -- Computer programs; Artificial intelligence -- Educational applications; Artificial intelligence -- Industrial applications; System design; Kunstmatige intelligentie; Electronic journals; Periodicals; Periodicals; 006.305
• DOI: 10.1002/aaai.12068
• Languages: English
• ISSNs: 0738-4602

Abstract

Abstract: With the advances of deep learning techniques, text generation is attracting increasing interest in the artificial intelligence (AI) community, because of its wide applications and because it is an essential component of AI. Traditional text generation systems are trained in a supervised way, requiring massive labeled parallel corpora. In this paper, I will introduce our recent work on search and learning approaches to unsupervised text generation, where a heuristic objective function estimates the quality of a candidate sentence, and discrete search algorithms generate a sentence by maximizing the search objective. A machine learning model further learns from the search results to smooth out noise and improve efficiency. Our approach is important to the industry for building minimal viable products for a new task; it also has high social impacts for saving human annotation labor and for processing low‐resource languages. Link to video abstract: https://youtu.be/Xir1e9g6oIc