ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume V-2-2021
ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., V-2-2021, 75–82, 2021
https://doi.org/10.5194/isprs-annals-V-2-2021-75-2021
ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., V-2-2021, 75–82, 2021
https://doi.org/10.5194/isprs-annals-V-2-2021-75-2021

  17 Jun 2021

17 Jun 2021

BIDIRECTIONAL MULTI-SCALE ATTENTION NETWORKS FOR SEMANTIC SEGMENTATION OF OBLIQUE UAV IMAGERY

Y. Lyu1, G. Vosselman1, G.-S. Xia2, and M. Y. Yang1 Y. Lyu et al.
  • 1University of Twente, The Netherlands
  • 2Wuhan University, China

Keywords: Semantic Segmentation, Multi-Scale, Attention, Oblique View, UAV, Deep Learning

Abstract. Semantic segmentation for aerial platforms has been one of the fundamental scene understanding task for the earth observation. Most of the semantic segmentation research focused on scenes captured in nadir view, in which objects have relatively smaller scale variation compared with scenes captured in oblique view. The huge scale variation of objects in oblique images limits the performance of deep neural networks (DNN) that process images in a single scale fashion. In order to tackle the scale variation issue, in this paper, we propose the novel bidirectional multi-scale attention networks, which fuse features from multiple scales bidirectionally for more adaptive and effective feature extraction. The experiments are conducted on the UAVid2020 dataset and have shown the effectiveness of our method. Our model achieved the state-of-the-art (SOTA) result with a mean intersection over union (mIoU) score of 70.80%.