Adaptive-Attentive Geolocalization From Few Queries: A Hybrid Approach

• Main Authors: Berton, G. (Author), Caputo, B. (Author), Masone, C. (Author), Montagna, F. (Author), Paolicelli, V. (Author)
• Format: Article
• Language: English
• Published: Frontiers Media S.A. 2022
• Subjects: domain adaptation (DA); domain generalization; few-shot domain adaptation; visual geolocalization; visual place recognition (VPR)
• Online Access: View Fulltext in Publisher

 We tackle the task of cross-domain visual geo-localization, where the goal is to geo-localize a given query image against a database of geo-tagged images, in the case where the query and the database belong to different visual domains. In particular, at training time, we consider having access to only few unlabeled queries from the target domain. To adapt our deep neural network to the database distribution, we rely on a 2-fold domain adaptation technique, based on a hybrid generative-discriminative approach. To further enhance the architecture, and to ensure robustness across domains, we employ a novel attention layer that can easily be plugged into existing architectures. Through a large number of experiments, we show that this adaptive-attentive approach makes the model robust to large domain shifts, such as unseen cities or weather conditions. Finally, we propose a new large-scale dataset for cross-domain visual geo-localization, called SVOX. Copyright © 2022 Paolicelli, Berton, Montagna, Masone and Caputo.