Reinforcement learning approach to the control of heavy material handling manipulators for agricultural robots. (December 2022)

• Record Type: Journal Article
• Authors: Wu, Xiaoming; Chi, Jing; Jin, Xiao-Zheng; Deng, Chao
• Is Part Of: Computers & electrical engineering. Volume 104:Part B(2022)
• Publication Date: 2022-12
• Subjects: Agricultural robots -- Policy iteration algorithm -- Value iteration algorithm -- Optimal control; Computer engineering -- Periodicals; Electrical engineering -- Periodicals; Electrical engineering -- Data processing -- Periodicals; Ordinateurs -- Conception et construction -- Périodiques; Électrotechnique -- Périodiques; Électrotechnique -- Informatique -- Périodiques; Computer engineering; Electrical engineering; Electrical engineering -- Data processing; Periodicals; Electronic journals; 621.302854
• DOI: 10.1016/j.compeleceng.2022.108433
• Languages: English
• ISSNs: 0045-7906

Abstract

Abstract: In this paper, we consider the optimal control problem of heavy material handling manipulators for agricultural robots. Unlike the existing results on agricultural robots, the robot parameters may be unknown for the designer in this paper. To learn the linear quadratic control gain under unknown robot parameters, two reinforcement learning algorithms, i.e., policy iteration (PI) algorithm and value iteration (VI) algorithm, are proposed. Then, through combining the advantages of PI algorithm and VI algorithm, i.e., satisfactory convergence rate and without the restriction on feasibility initial control policy, respectively, a hybrid iteration (HI) algorithm is proposed, which can both achieve a satisfactory convergence rate and remove restrictions on feasibility initial control policy. It is shown that the convergence of the proposed HI algorithm can be achieved in theory. Finally, a simulation example is given to show that our designed HI algorithm can achieve a satisfactory simulation time.