Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing Images
Nowadays, object detection methods based on deep learning are applied more and more to the interpretation of optical remote sensing images. However, the complex background and the wide range of object sizes in remote sensing images increase the difficulty of object detection. In this paper, we impro...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2020-07-01
|
Series: | Remote Sensing |
Subjects: | |
Online Access: | https://www.mdpi.com/2072-4292/12/15/2416 |
id |
doaj-b711feecdc9b411195205788015f86da |
---|---|
record_format |
Article |
spelling |
doaj-b711feecdc9b411195205788015f86da2020-11-25T02:56:31ZengMDPI AGRemote Sensing2072-42922020-07-01122416241610.3390/rs12152416Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing ImagesZhuangzhuang Tian0Ronghui Zhan1Jiemin Hu2Wei Wang3Zhiqiang He4Zhaowen Zhuang5College of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, ChinaCollege of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, ChinaSchool of Informatics Science and Technology, Zhejiang Sci-Tech University, Hangzhou 310018, ChinaCollege of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, ChinaCollege of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, ChinaCollege of Electronic Science and Technology, National University of Defense Technology, Changsha 410073, ChinaNowadays, object detection methods based on deep learning are applied more and more to the interpretation of optical remote sensing images. However, the complex background and the wide range of object sizes in remote sensing images increase the difficulty of object detection. In this paper, we improve the detection performance by combining the attention information, and generate adaptive anchor boxes based on the attention map. Specifically, the attention mechanism is introduced into the proposed method to enhance the features of the object regions while reducing the influence of the background. The generated attention map is then used to obtain diverse and adaptable anchor boxes using the guided anchoring method. The generated anchor boxes can match better with the scene and the objects, compared with the traditional proposal boxes. Finally, the modulated feature adaptation module is applied to transform the feature maps to adapt to the diverse anchor boxes. Comprehensive evaluations on the DIOR dataset demonstrate the superiority of the proposed method over the state-of-the-art methods, such as RetinaNet, FCOS and CornerNet. The mean average precision of the proposed method is 4.5% higher than the feature pyramid network. In addition, the ablation experiments are also implemented to further analyze the respective influence of different blocks on the performance improvement.https://www.mdpi.com/2072-4292/12/15/2416remote sensingobject detectionconvolutional neural networkattention mechanism |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Zhuangzhuang Tian Ronghui Zhan Jiemin Hu Wei Wang Zhiqiang He Zhaowen Zhuang |
spellingShingle |
Zhuangzhuang Tian Ronghui Zhan Jiemin Hu Wei Wang Zhiqiang He Zhaowen Zhuang Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing Images Remote Sensing remote sensing object detection convolutional neural network attention mechanism |
author_facet |
Zhuangzhuang Tian Ronghui Zhan Jiemin Hu Wei Wang Zhiqiang He Zhaowen Zhuang |
author_sort |
Zhuangzhuang Tian |
title |
Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing Images |
title_short |
Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing Images |
title_full |
Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing Images |
title_fullStr |
Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing Images |
title_full_unstemmed |
Generating Anchor Boxes Based on Attention Mechanism for Object Detection in Remote Sensing Images |
title_sort |
generating anchor boxes based on attention mechanism for object detection in remote sensing images |
publisher |
MDPI AG |
series |
Remote Sensing |
issn |
2072-4292 |
publishDate |
2020-07-01 |
description |
Nowadays, object detection methods based on deep learning are applied more and more to the interpretation of optical remote sensing images. However, the complex background and the wide range of object sizes in remote sensing images increase the difficulty of object detection. In this paper, we improve the detection performance by combining the attention information, and generate adaptive anchor boxes based on the attention map. Specifically, the attention mechanism is introduced into the proposed method to enhance the features of the object regions while reducing the influence of the background. The generated attention map is then used to obtain diverse and adaptable anchor boxes using the guided anchoring method. The generated anchor boxes can match better with the scene and the objects, compared with the traditional proposal boxes. Finally, the modulated feature adaptation module is applied to transform the feature maps to adapt to the diverse anchor boxes. Comprehensive evaluations on the DIOR dataset demonstrate the superiority of the proposed method over the state-of-the-art methods, such as RetinaNet, FCOS and CornerNet. The mean average precision of the proposed method is 4.5% higher than the feature pyramid network. In addition, the ablation experiments are also implemented to further analyze the respective influence of different blocks on the performance improvement. |
topic |
remote sensing object detection convolutional neural network attention mechanism |
url |
https://www.mdpi.com/2072-4292/12/15/2416 |
work_keys_str_mv |
AT zhuangzhuangtian generatinganchorboxesbasedonattentionmechanismforobjectdetectioninremotesensingimages AT ronghuizhan generatinganchorboxesbasedonattentionmechanismforobjectdetectioninremotesensingimages AT jieminhu generatinganchorboxesbasedonattentionmechanismforobjectdetectioninremotesensingimages AT weiwang generatinganchorboxesbasedonattentionmechanismforobjectdetectioninremotesensingimages AT zhiqianghe generatinganchorboxesbasedonattentionmechanismforobjectdetectioninremotesensingimages AT zhaowenzhuang generatinganchorboxesbasedonattentionmechanismforobjectdetectioninremotesensingimages |
_version_ |
1724713658719666176 |