An Instance Segmentation-Based Framework for a Large-Sized High-Resolution Remote Sensing Image Registration

• Main Authors: Junyan Lu, Hongguang Jia, Tie Li, Zhuqiang Li, Jingyu Ma, Ruifei Zhu
• Format: Article
• Language: English
• Published: MDPI AG 2021-04-01
• Series: Remote Sensing
• Subjects: registration; large-sized high-resolution remote sensing image; instance segmentation; Convolutional Neural Network; instance matching; outlier removal
• Online Access: https://www.mdpi.com/2072-4292/13/9/1657

Feature-based remote sensing image registration methods have achieved great accomplishments. However, they have faced some limitations of applicability, automation, accuracy, efficiency, and robustness for large high-resolution remote sensing image registration. To address the above issues, we propose a novel instance segmentation-based registration framework specifically for large-sized high-resolution remote sensing images. First, we design an instance segmentation model based on a convolutional neural network (CNN), which can efficiently extract fine-grained instances as the deep features for local area matching. Then, a feature-based method combined with the instance segmentation results is adopted to acquire more accurate local feature matching. Finally, multi-constraints based on the instance segmentation results are introduced to work on the outlier removal. In the experiments of high-resolution remote sensing image registration, the proposal effectively copes with the circumstance of the sensed image with poor positioning accuracy. In addition, the method achieves superior accuracy and competitive robustness compared with state-of-the-art feature-based methods, while being rather efficient.