ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Download
Publications Copernicus
Download
Citation
Articles | Volume V-3-2020
ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., V-3-2020, 233–240, 2020
https://doi.org/10.5194/isprs-annals-V-3-2020-233-2020
ISPRS Ann. Photogramm. Remote Sens. Spatial Inf. Sci., V-3-2020, 233–240, 2020
https://doi.org/10.5194/isprs-annals-V-3-2020-233-2020

  03 Aug 2020

03 Aug 2020

GEOMETRIC AND NON-LINEAR RADIOMETRIC DISTORTION ROBUST MULTIMODAL IMAGE MATCHING VIA EXPLOITING DEEP FEATURE MAPS

M. Chen1, Y. Zhao1, T. Fang1, Q. Zhu1, S. Yan1, and F. Gao2 M. Chen et al.
  • 1Faculty of Geosciences and Environmental Engineering, Southwest Jiaotong University, Chengdu, 611756, China
  • 2Shenzhen Real Estate Bid Center, China

Keywords: Image Matching, Multimodal Images, Geometric Distortion, Non-linear Radiometric Distortion, Deep Feature Maps

Abstract. Image matching is a fundamental issue of multimodal images fusion. Most of recent researches only focus on the non-linear radiometric distortion on coarsely registered multimodal images. The global geometric distortion between images should be eliminated based on prior information (e.g. direct geo-referencing information and ground sample distance) before using these methods to find correspondences. However, the prior information is not always available or accurate enough. In this case, users have to select some ground control points manually to do image registration and make the methods work. Otherwise, these methods will fail. To overcome this problem, we propose a robust deep learning-based multimodal image matching method that can deal with geometric and non-linear radiometric distortion simultaneously by exploiting deep feature maps. It is observed in our study that some of the deep feature maps have similar grayscale distribution and correspondences can be found from these maps using traditional geometric distortion robust matching methods even significant non-linear radiometric difference exists between the original images. Therefore, we can only focus on the geometric distortion when we deal with deep feature maps, and then only focus on non-linear radiometric distortion in patches similarity measurement. The experimental results demonstrate that the proposed method performs better than the state-of-the-art matching methods on multimodal images with both geometric and non-linear radiometric distortion.