High-Resolution Remote Sensing Image Retrieval Based on CNNs from a Dimensional Perspective

• Main Authors: Zhifeng Xiao, Yang Long, Deren Li, Chunshan Wei, Gefu Tang, Junyi Liu
• Format: Article
• Language: English
• Published: MDPI AG 2017-07-01
• Series: Remote Sensing
• Subjects: remote sensing image retrieval; Deep Compact Codes (DCC); Feature Weighted Map (FWM); CNN features; dimension reduction
• Online Access: https://www.mdpi.com/2072-4292/9/7/725

Because of recent advances in Convolutional Neural Networks (CNNs), traditional CNNs have been employed to extract thousands of codes as feature representations for image retrieval. In this paper, we propose that more powerful features for high-resolution remote sensing image representations can be learned using only several tens of codes; this approach can improve the retrieval accuracy and decrease the time and storage requirements. To accomplish this goal, we first investigate the learning of a series of features with different dimensions using a few tens to thousands of codes via our improved CNN frameworks. Then, a Principal Component Analysis (PCA) is introduced to compress the high-dimensional remote sensing image feature codes learned by traditional CNNs. Comprehensive comparisons are conducted to evaluate the retrieval performance based on feature codes of different dimensions learned by the improved CNNs as well as the PCA compression. To further demonstrate the powerful ability of the low-dimensional feature representation learned by the improved CNN frameworks, a Feature Weighted Map (FWM), which can perform feature visualization and provides a better understanding of the nature of Deep Convolutional Neural Networks (DCNNs) frameworks, is explored. All the CNN models are trained from scratch using a large-scale and high-resolution remote sensing image archive, which will be published and made available to the public. The experimental results show that our method outperforms state-of-the-art CNN frameworks in terms of accuracy and storage.