Attention-based two-stream high-resolution networks for building damage assessment from satellite imagery

Victor Oludare; Landry Kezebou; Obafemi Jinadu; Karen Panetta; Sos Agaian

doi:10.1117/12.2618901

27 May 2022 Attention-based two-stream high-resolution networks for building damage assessment from satellite imagery

Victor Oludare, Landry Kezebou, Obafemi Jinadu, Karen Panetta, Sos Agaian

Proceedings Volume 12100, Multimodal Image Exploitation and Learning 2022; 121000L (2022) https://doi.org/10.1117/12.2618901
Event: SPIE Defense + Commercial Sensing, 2022, Orlando, Florida, United States

Conference Poster

Abstract

Satellite imagery provides an efficient means of assessing and effectively planning search and rescue efforts in the aftermath of disasters such as earthquakes, flooding, tsunamis, wildfires, and conflicts. It enables timely visualization of buildings and the human population affected by these disasters and provides humanitarian organizations with crucial information needed to strategize and deliver the much need aid effectively. Recent research on remote sensing combines machine learning methodologies with satellite imagery to automate information extraction, thus reducing turn-around time and manual labor. The existing state-of-the-art approach for building damage assessment relies on an ensemble of different models to obtain independent predictions that are then aggregated to one final output. Other methods rely on a multi-stage model that involves a building localization module and a damage classification module. These methods are either not end-to-end trainable or are impractical for real-time applications. This paper proposes an Attention-based Two-Stream High-Resolution Network (ATS-HRNet), which unifies the building localization and classification problem in an end-to-end trainable manner. The basic residual blocks in HRNet are replaced with attention-based residual blocks to improve the model's performance. Furthermore, a modified cutmix data augmentation technique is introduced for handling class imbalance in satellite imagery. Experiments show that our approach significantly performs better than the baseline and other state-of-the-art methods for building damage classification.

Citation Download Citation

Victor Oludare, Landry Kezebou, Obafemi Jinadu, Karen Panetta, and Sos Agaian "Attention-based two-stream high-resolution networks for building damage assessment from satellite imagery", Proc. SPIE 12100, Multimodal Image Exploitation and Learning 2022, 121000L (27 May 2022); https://doi.org/10.1117/12.2618901

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available