Estimating building energy efficiency from street view imagery, aerial imagery, and land surface temperature data. (1st March 2023)

• Record Type: Journal Article
• Authors: Mayer, Kevin; Haas, Lukas; Huang, Tianyuan; Bernabé-Moreno, Juan; Rajagopal, Ram; Fischer, Martin
• Is Part Of: Applied energy. Volume 333(2023)
• Publication Date: 2023-03-01
• Subjects: Building energy efficiency -- Decarbonization -- Retrofitting -- Remote sensing -- End-to-end deep learning -- Ablation study; Power (Mechanics) -- Periodicals; Energy conservation -- Periodicals; Energy conversion -- Periodicals; 621.042
• DOI: 10.1016/j.apenergy.2022.120542
• Languages: English
• ISSNs: 0306-2619

Abstract

Abstract: Current methods to determine the energy efficiency of buildings generally require on-site visits of certified energy auditors which makes the process slow, costly, and geographically incomplete. To accelerate the identification of promising retrofit targets on a large scale, we propose to estimate building energy efficiency from widely available and remotely sensed data sources only, namely street view, aerial view, footprint, and satellite-borne land surface temperature (LST) data. After collecting data for almost 40, 000 buildings in the United Kingdom, we combine these data sources by training multiple end-to-end deep learning models with the objective to classify buildings as energy efficient (EU rating A–D) or inefficient (EU rating E–G). After evaluating the trained models quantitatively as well as qualitatively, we extend our analysis by studying the predictive power of each data source in an ablation study. We find that the end-to-end deep learning model trained on all four data sources achieves a macro-averaged F1 score of 64.64% and outperforms models trained on building energy consumption data by 9.78%. As industry experts use building energy consumption data to approximate a building's energy efficiency prior to a potential on-site inspection, this work shows the potential and complementary nature of remotely sensed data in predicting energy efficiency and opens up new opportunities for future work to integrate additional data sources. Highlights: Fast, scalable, and non-intrusive method to estimate building energy efficiency. End-to-end deep learning (DL) model fuses remotely sensed data sources. K-Means clustering of street view embeddings speeds up data cleaning significantly. Integrated gradients method enables qualitative analysis of end-to-end DL model. Comprehensive ablation study underscores the complementary nature of data sources.