A diffusion wavelets-based multiscale framework for inverse optimal control of stochastic systems. Issue 11 (18th August 2021)

• Record Type: Journal Article
• Authors: Ha, Jung-Su; Chae, Hyeok-Joo; Choi, Han-Lim
• Is Part Of: International journal of systems science. Volume 52:Issue 11(2021)
• Page Start: 2228
• Page End: 2240
• Publication Date: 2021-08-18
• Subjects: Inverse optimal control -- diffusion wavelets -- multiresolution analysis; System analysis -- Periodicals; 003.3
• DOI: 10.1080/00207721.2021.1882011
• Languages: English
• ISSNs: 0020-7721

Abstract

Abstract : This work presents a multiscale framework to solve a class of inverse optimal control (IOC) problems in the context of robot motion planning and control in a complex environment. In order to handle complications resulting from a large decision space and complex environmental geometry, two key concepts are adopted: (a) a diffusion wavelet representation of the Markov chain for hierarchical abstraction of the state space; and (b) a desirability function-based representation of the Markov decision process (MDP) to efficiently calculate the optimal policy. An IOC problem constructed on a 'abstract state' is solved, which is much more tractable than using the original bases set; moreover, the solution can be obtained recursively in the 'coarse to fine' direction by utilizing the hierarchical structure of basis functions. The resulting multiscale plan is utilized to finally compute a continuous-time optimal control policy within a receding horizon implementation. Illustrative numerical experiments on a robot path control in a complex environment and on a quadrotor ball-catching task are presented to verify the proposed method.