CntrlDA: A building energy management control system with real-time adjustments. Application to indoor temperature. (1st May 2022)

• Record Type: Journal Article
• Authors: Dmitrewski, Alex; Molina-Solana, Miguel; Arcucci, Rossella
• Is Part Of: Building and environment. Volume 215(2022)
• Publication Date: 2022-05-01
• Subjects: Building energy control -- Reinforcement learning -- Data assimilation; Buildings -- Environmental engineering -- Periodicals; Building -- Research -- Periodicals; Constructions -- Technique de l'environnement -- Périodiques; Electronic journals; 696
• DOI: 10.1016/j.buildenv.2022.108938
• Languages: English
• ISSNs: 0360-1323

Abstract

Abstract: Rule-Based Control (RBC) and Model Predictive Control (MPC) have been traditionally used to control building heating, ventilation and air conditioning (HVAC) systems. They, however, present shortcomings when faced with efficiently controlling these systems at a larger level. Reinforcement Learning (RL) has recently emerged as a viable alternative, showing promising results compared to previous methods, but still having some difficulties with untrained situations or sudden changes. CntrlDA is our proposal on improving the RL formulation by coupling it with data assimilation (DA), a technique commonly used in numerical weather prediction. Our battery of experiments, in a building simulation environment, shows that training a RL control agent with DA and external data, leads to better performance than training the agent using only the simulation data. The RL control agent with DA maintains the temperature range 15.6% more often than the RL control agent without DA. It is also shown that by including a DA stage in the control process, the agent better deals with unexpected events (which are common in real-life systems and particularly in building energy control scenarios). We show that it maintains the range 15.4% more often than the system without DA with no significant added cost of resources. Graphical abstract: Highlights: We have developed a smart energy management control system named CntrlDA. CntrlDA uses reinforcement learning (RL) technology to train a control agent. CntrlDA integrates data assimilation (DA) with the RL technology. Adding DA to agent training in RL, improves its ability to adapt to sudden changes.