Energy-efficient heating control for smart buildings with deep reinforcement learning. (February 2021)

• Record Type: Journal Article
• Authors: Gupta, Anchal; Badr, Youakim; Negahban, Ashkan; Qiu, Robin G.
• Is Part Of: Journal of building engineering. Volume 34(2021)
• Publication Date: 2021-02
• Subjects: Deep reinforcement learning -- Simulation -- Occupant thermal comfort -- Heating controller -- HVAC; Building -- Periodicals; 690.05
• DOI: 10.1016/j.jobe.2020.101739
• Languages: English
• ISSNs: 2352-7102

Abstract

Abstract: Buildings account for roughly 40% of the total energy consumption in the world, out of which heating, ventilation, and air conditioning are the major contributors. Traditional heating controllers are inefficient due to lack of adaptability to dynamic conditions such as changing user preferences and outside temperature patterns. Therefore, it is necessary to design energy-efficient controllers that can improvise occupant thermal comfort (deviation from setpoint temperature) while reducing energy consumption. This research presents a Deep Reinforcement Learning (DRL)-based heating controller to improve thermal comfort and minimize energy costs in smart buildings. We perform extensive simulation experiments using real-world outside temperature data. The results show that the DRL-based smart controller outperforms a traditional thermostat controller by improving thermal comfort between 15% and 30% and reducing energy costs between 5% and 12% in the simulated environment. A second set of experiments is then performed for the case of multiple buildings, each having its own heating equipment. The performance is compared when the buildings are controlled centrally (using a single DRL-based controller) versus decentralized control, where each heater is controlled independently and has its own DRL-based controller. We observe that as the number of buildings and differences in their setpoint temperatures increase, decentralized control performs better than a centralized controller. The results have practical implications for heating control, especially in areas with multiple buildings such as residential complexes with multiple houses. Highlights: Proposed Deep reinforcement learning algorithms for efficient heating control in smart buildings. Proposed a method that reduces deviation from the user's preferred temperature while reducing energy costs. Experiments demonstrate that a decentralized control performs better than centralized control for multiple smart buildings.