Maximum Likelihood Methods for Inverse Learning of Optimal Controllers⁎This work was supported by the Swiss National Science Foundation under grant no. PP00P2_157601 / 1. Issue 2 (2020)

• Record Type: Journal Article
• Authors: Menner, Marcel; Zeilinger, Melanie N.
• Is Part Of: IFAC-PapersOnLine. Volume 53:Issue 2(2020)
• Page Start: 5266
• Page End: 5272
• Publication Date: 2020
• Subjects: Learning for control -- data-based control -- constrained control; Automatic control -- Periodicals; 629.805
• DOI: 10.1016/j.ifacol.2020.12.1206
• Languages: English
• ISSNs: 2405-8963

Abstract

Abstract: This paper presents a framework for inverse learning of objective functions for constrained optimal control problems, which is based on the Karush-Kuhn-Tucker (KKT) conditions. We discuss three variants corresponding to different model assumptions and computational complexities. The first method uses a convex relaxation of the KKT conditions and serves as the benchmark. The main contribution of this paper is the proposition of two learning methods that combine the KKT conditions with maximum likelihood estimation. The key benefit of this combination is the systematic treatment of constraints for learning from noisy data with a branch-and-bound algorithm using likelihood arguments. This paper discusses theoretic properties of the learning methods and presents simulation results that highlight the advantages of using the maximum likelihood formulation for learning objective functions.