Joint control of manufacturing and onsite microgrid system via novel neural-network integrated reinforcement learning algorithms. (1st June 2022)

• Record Type: Journal Article
• Authors: Yang, Jiaojiao; Sun, Zeyi; Hu, Wenqing; Steinmeister, Louis
• Is Part Of: Applied energy. Volume 315(2022)
• Publication Date: 2022-06-01
• Subjects: Microgrid -- Manufacturing -- Reinforcement Learning -- Markov Decision Process -- Temporal Difference Learning -- Deterministic Policy Gradient; Power (Mechanics) -- Periodicals; Energy conservation -- Periodicals; Energy conversion -- Periodicals; 621.042
• DOI: 10.1016/j.apenergy.2022.118982
• Languages: English
• ISSNs: 0306-2619

Abstract

Highlights: This paper proposes a joint energy control model for microgrid and manufacturing. Markov decision process is used to model the decision procedure. Reinforcement learning leveraging TD and DPG is proposed to solve the problem. Abstract: Microgrid is a promising technology of distributed energy supply system, which consists of storage devices, generation capacities including renewable sources, and controllable loads. It has been widely investigated and applied for residential and commercial end-use customers as well as critical facilities. In this paper, we propose a joint state-based dynamic control model on microgrids and manufacturing systems where optimal controls for both sides are implemented to coordinate the energy demand and supply so that the overall production cost can be minimized considering the constraint of production target. Markov Decision Process (MDP) is used to formulate the decision-making procedure. The main computing challenge to solve the formulated MDP lies in the co-existence of both discrete and continuous parts of the high-dimensional state/action space that are intertwined with constraints. A novel reinforcement learning algorithm that leverages both Temporal Difference (TD) and Deterministic Policy Gradient (DPG) algorithms is proposed to address the computation challenge. Experiments for a manufacturing system with an onsite microgrid system with renewable sources have been implemented to justify the effectiveness of the proposed method.