Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing Images

Nowadays, object detection methods based on deep learning are applied more and more to the interpretation of optical remote sensing images. However, the complex background and the wide range of object sizes in remote sensing images increase the difficulty of object detection. In this paper, we impro...

Full description

Bibliographic Details
Main Authors: Zhuangzhuang Tian, Ronghui Zhan, Jiemin Hu, Wei Wang, Zhiqiang He, Zhaowen Zhuang
Format: Article
Language:English
Published: MDPI AG 2020-07-01
Series:Remote Sensing
Subjects:
Online Access:https://www.mdpi.com/2072-4292/12/15/2416
id doaj-b711feecdc9b411195205788015f86da
record_format Article
spelling doaj-b711feecdc9b411195205788015f86da2020-11-25T02:56:31ZengMDPI AGRemote Sensing2072-42922020-07-01122416241610.3390/rs12152416Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing ImagesZhuangzhuang Tian0Ronghui Zhan1Jiemin Hu2Wei Wang3Zhiqiang He4Zhaowen Zhuang5College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, ChinaCollege of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, ChinaSchool of Informatics Science and Technology, Zhejiang Sci-Tech University, Hangzhou 310018, ChinaCollege of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, ChinaCollege of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, ChinaCollege of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, ChinaNowadays, object detection methods based on deep learning are applied more and more to the interpretation of optical remote sensing images. However, the complex background and the wide range of object sizes in remote sensing images increase the difficulty of object detection. In this paper, we improve the detection performance by combining the attention information, and generate adaptive anchor boxes based on the attention map. Specifically, the attention mechanism is introduced into the proposed method to enhance the features of the object regions while reducing the influence of the background. The generated attention map is then used to obtain diverse and adaptable anchor boxes using the guided anchoring method. The generated anchor boxes can match better with the scene and the objects, compared with the traditional proposal boxes. Finally, the modulated feature adaptation module is applied to transform the feature maps to adapt to the diverse anchor boxes. Comprehensive evaluations on the DIOR dataset demonstrate the superiority of the proposed method over the state-of-the-art methods, such as RetinaNet, FCOS and CornerNet. The mean average precision of the proposed method is 4.5% higher than the feature pyramid network. In addition, the ablation experiments are also implemented to further analyze the respective influence of different blocks on the performance improvement.https://www.mdpi.com/2072-4292/12/15/2416remote sensingobject detectionconvolutional neural networkattention mechanism
collection DOAJ
language English
format Article
sources DOAJ
author Zhuangzhuang Tian
Ronghui Zhan
Jiemin Hu
Wei Wang
Zhiqiang He
Zhaowen Zhuang
spellingShingle Zhuangzhuang Tian
Ronghui Zhan
Jiemin Hu
Wei Wang
Zhiqiang He
Zhaowen Zhuang
Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing Images
Remote Sensing
remote sensing
object detection
convolutional neural network
attention mechanism
author_facet Zhuangzhuang Tian
Ronghui Zhan
Jiemin Hu
Wei Wang
Zhiqiang He
Zhaowen Zhuang
author_sort Zhuangzhuang Tian
title Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing Images
title_short Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing Images
title_full Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing Images
title_fullStr Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing Images
title_full_unstemmed Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing Images
title_sort generating anchor boxes based on attention mechanism for object detection in remote sensing images
publisher MDPI AG
series Remote Sensing
issn 2072-4292
publishDate 2020-07-01
description Nowadays, object detection methods based on deep learning are applied more and more to the interpretation of optical remote sensing images. However, the complex background and the wide range of object sizes in remote sensing images increase the difficulty of object detection. In this paper, we improve the detection performance by combining the attention information, and generate adaptive anchor boxes based on the attention map. Specifically, the attention mechanism is introduced into the proposed method to enhance the features of the object regions while reducing the influence of the background. The generated attention map is then used to obtain diverse and adaptable anchor boxes using the guided anchoring method. The generated anchor boxes can match better with the scene and the objects, compared with the traditional proposal boxes. Finally, the modulated feature adaptation module is applied to transform the feature maps to adapt to the diverse anchor boxes. Comprehensive evaluations on the DIOR dataset demonstrate the superiority of the proposed method over the state-of-the-art methods, such as RetinaNet, FCOS and CornerNet. The mean average precision of the proposed method is 4.5% higher than the feature pyramid network. In addition, the ablation experiments are also implemented to further analyze the respective influence of different blocks on the performance improvement.
topic remote sensing
object detection
convolutional neural network
attention mechanism
url https://www.mdpi.com/2072-4292/12/15/2416
work_keys_str_mv AT zhuangzhuangtian generatinganchorboxesbasedonattentionmechanismforobjectdetectioninremotesensingimages
AT ronghuizhan generatinganchorboxesbasedonattentionmechanismforobjectdetectioninremotesensingimages
AT jieminhu generatinganchorboxesbasedonattentionmechanismforobjectdetectioninremotesensingimages
AT weiwang generatinganchorboxesbasedonattentionmechanismforobjectdetectioninremotesensingimages
AT zhiqianghe generatinganchorboxesbasedonattentionmechanismforobjectdetectioninremotesensingimages
AT zhaowenzhuang generatinganchorboxesbasedonattentionmechanismforobjectdetectioninremotesensingimages
_version_ 1724713658719666176