Practical Implementation Method of Reinforcement Learning for Power Converter. Issue 9 (2022)

• Record Type: Journal Article
• Authors: Kwon, Soonhyung; Yoon, Changwoo; Lee, Young-Il
• Is Part Of: IFAC-PapersOnLine. Volume 55:Issue 9(2022)
• Page Start: 437
• Page End: 441
• Publication Date: 2022
• Subjects: Reinforcement Learning -- DDPG -- Power Electronics -- Buck Converter -- Microcontroller; Automatic control -- Periodicals; 629.805
• DOI: 10.1016/j.ifacol.2022.07.076
• Languages: English
• ISSNs: 2405-8963

Abstract

Abstract: Reinforcement Learning (RL) is a field of machine learning that is widely used to control complex systems such as games. It has the advantage of finding optimal control input at a specific state through the iterative learning process. Recently, RL has been considered for the power electronics application having nonlinearities with multiple inputs due to empirically finding the optimal control input. This paper is about the DC/DC converter control using the DDPG (Deep Deterministic Policy Gradient). During the DDPG training, permanent damage to the experimental setup may occur. Thus, an offline training environment is created, and the neural network training for the DDPG is performed using iterative PC simulations. The acquired artificial neural network gains are directly applied to the experimental setup, and it improves the control performance compared to the conventional PI controller. Also, unlike previous papers that were performed on the costly FPGAs to solve artificial neural networks, in this paper, the size of neural networks is reduced sufficiently. Thus, the RL algorithm can be implemented with only a cost-effective microcontroller.