Towards fully automated post-event data collection and analysis: Pre-event and post-event information fusion. (1st April 2020)

• Record Type: Journal Article
• Authors: Lenjani, Ali; Dyke, Shirley J.; Bilionis, Ilias; Yeum, Chul Min; Kamiya, Kenzo; Choi, Jongseong; Liu, Xiaoyu; Chowdhury, Arindam G.
• Is Part Of: Engineering structures. Volume 208(2020)
• Publication Date: 2020-04-01
• Subjects: Artificial intelligence -- Data-driven decision making -- Post-event reconnaissance -- Resilience -- Convolutional neural networks -- Machine learning -- Bayesian information fusion -- Automated data analysis; Structural engineering -- Periodicals; Structural analysis (Engineering) -- Periodicals; Construction, Technique de la -- Périodiques; Génie parasismique -- Périodiques; Pression du vent -- Périodiques; Earthquake engineering; Structural engineering; Wind-pressure; Periodicals; 624.105
• DOI: 10.1016/j.engstruct.2019.109884
• Languages: English
• ISSNs: 0141-0296

Abstract

Highlights: This technique supports engineers by providing automated capabilities to make decisions in the field. Improving consistency and accelerating decisions, an imperative after a major disruptive event. Automated post-event data collection to facilitate the data analysis process and reduce bias in the results. Abstract: In post-event reconnaissance missions, engineers and researchers collect perishable information about damaged buildings in the affected geographical region to learn from the consequences of the event. A typical post-event reconnaissance mission is conducted by first doing a preliminary survey, followed by a detailed survey. The objective of the preliminary survey is to develop an understanding of the overall situation in the field, and use that information to plan the detailed survey. The preliminary survey is typically conducted by driving slowly along a pre-determined route, observing the damage, and noting where further detailed data should be collected. This involves several manual, time-consuming steps that can be accelerated by exploiting recent advances in computer vision and artificial intelligence. The objective of this work is to develop and validate an automated technique to support post-event reconnaissance teams in the rapid collection of reliable and sufficiently comprehensive data, for planning the detailed survey. The focus here is on residential buildings. The technique incorporates several methods designed to automate the process of categorizing buildings based on their key physical attributes, and rapidly assessing their post-event structural condition. It is divided into pre-event and post-event streams, each intending to first extract all possible information about the target buildings using both pre-event and post-event images. Algorithms based on convolutional neural networks (CNNs) are implemented for scene (image) classification. A probabilistic approach is developed to fuse the results obtained from analyzing several images to yield a robust decision regarding the attributes and condition of a target building. We validate the technique using post-event images captured during reconnaissance missions that took place after hurricanes Harvey and Irma. The validation data were collected by a structural wind and coastal engineering reconnaissance team, the National Science Foundation (NSF) funded Structural Extreme Events Reconnaissance (StEER) Network.