Unsupervised Multi-Scale-Stage Content-Aware Homography Estimation

• Main Authors: Hou, B. (Author), Ren, J. (Author), Yan, W. (Author)
• Format: Article
• Language: English
• Published: MDPI 2023
• Subjects: feature matching; multi-scale; multi-stage; self-attention-augmented ConvNet; unsupervised
• Online Access: View Fulltext in Publisher; View in Scopus
• ISBN: 20799292 (ISSN)
• DOI: 10.3390/electronics12091976

Homography estimation is a critical component in many computer-vision tasks. However, most deep homography methods focus on extracting local features and ignore global features or the corresponding relationship between features from two images or video frames. These methods are effective for alignment of image pairs with small displacement. In this paper, we propose an unsupervised Multi-Scale-Stage Content-Aware Homography Estimation Network (MS2CA-HENet). In the framework, we use multi-scale input images for different stages to cope with different scales of transformations. In each stage, we consider local and global features via our Self-Attention-augmented ConvNet (SAC). Furthermore, feature matching is explicitly enhanced using feature-matching modules. By shrinking the error residual of each stage, our network achieves coarse-to-fine results. Experiments show that our MS2CA-HENet achieves better results than other methods. © 2023 by the authors.