AFI-Net: Attention-Guided Feature Integration Network for RGBD Saliency Detection
This article proposes an innovative RGBD saliency model, that is, attention-guided feature integration network, which can extract and fuse features and perform saliency inference. Specifically, the model first extracts multimodal and level deep features. Then, a series of attention modules are deplo...
Main Authors: | , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Hindawi Limited
2021-01-01
|
Series: | Computational Intelligence and Neuroscience |
Online Access: | http://dx.doi.org/10.1155/2021/8861446 |
id |
doaj-89de6cd6b1bc490495a8d770c277d16b |
---|---|
record_format |
Article |
spelling |
doaj-89de6cd6b1bc490495a8d770c277d16b2021-04-12T01:24:21ZengHindawi LimitedComputational Intelligence and Neuroscience1687-52732021-01-01202110.1155/2021/8861446AFI-Net: Attention-Guided Feature Integration Network for RGBD Saliency DetectionLiming Li0Shuguang Zhao1Rui Sun2Xiaodong Chai3Shubin Zheng4Xingjie Chen5Zhaomin Lv6School of Information Science and TechnologySchool of Information Science and TechnologySchool of Urban Railway TransportationSchool of Urban Railway TransportationSchool of Urban Railway TransportationSchool of Urban Railway TransportationSchool of Urban Railway TransportationThis article proposes an innovative RGBD saliency model, that is, attention-guided feature integration network, which can extract and fuse features and perform saliency inference. Specifically, the model first extracts multimodal and level deep features. Then, a series of attention modules are deployed to the multilevel RGB and depth features, yielding enhanced deep features. Next, the enhanced multimodal deep features are hierarchically fused. Lastly, the RGB and depth boundary features, that is, low-level spatial details, are added to the integrated feature to perform saliency inference. The key points of the AFI-Net are the attention-guided feature enhancement and the boundary-aware saliency inference, where the attention module indicates salient objects coarsely, and the boundary information is used to equip the deep feature with more spatial details. Therefore, salient objects are well characterized, that is, well highlighted. The comprehensive experiments on five challenging public RGBD datasets clearly exhibit the superiority and effectiveness of the proposed AFI-Net.http://dx.doi.org/10.1155/2021/8861446 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Liming Li Shuguang Zhao Rui Sun Xiaodong Chai Shubin Zheng Xingjie Chen Zhaomin Lv |
spellingShingle |
Liming Li Shuguang Zhao Rui Sun Xiaodong Chai Shubin Zheng Xingjie Chen Zhaomin Lv AFI-Net: Attention-Guided Feature Integration Network for RGBD Saliency Detection Computational Intelligence and Neuroscience |
author_facet |
Liming Li Shuguang Zhao Rui Sun Xiaodong Chai Shubin Zheng Xingjie Chen Zhaomin Lv |
author_sort |
Liming Li |
title |
AFI-Net: Attention-Guided Feature Integration Network for RGBD Saliency Detection |
title_short |
AFI-Net: Attention-Guided Feature Integration Network for RGBD Saliency Detection |
title_full |
AFI-Net: Attention-Guided Feature Integration Network for RGBD Saliency Detection |
title_fullStr |
AFI-Net: Attention-Guided Feature Integration Network for RGBD Saliency Detection |
title_full_unstemmed |
AFI-Net: Attention-Guided Feature Integration Network for RGBD Saliency Detection |
title_sort |
afi-net: attention-guided feature integration network for rgbd saliency detection |
publisher |
Hindawi Limited |
series |
Computational Intelligence and Neuroscience |
issn |
1687-5273 |
publishDate |
2021-01-01 |
description |
This article proposes an innovative RGBD saliency model, that is, attention-guided feature integration network, which can extract and fuse features and perform saliency inference. Specifically, the model first extracts multimodal and level deep features. Then, a series of attention modules are deployed to the multilevel RGB and depth features, yielding enhanced deep features. Next, the enhanced multimodal deep features are hierarchically fused. Lastly, the RGB and depth boundary features, that is, low-level spatial details, are added to the integrated feature to perform saliency inference. The key points of the AFI-Net are the attention-guided feature enhancement and the boundary-aware saliency inference, where the attention module indicates salient objects coarsely, and the boundary information is used to equip the deep feature with more spatial details. Therefore, salient objects are well characterized, that is, well highlighted. The comprehensive experiments on five challenging public RGBD datasets clearly exhibit the superiority and effectiveness of the proposed AFI-Net. |
url |
http://dx.doi.org/10.1155/2021/8861446 |
work_keys_str_mv |
AT limingli afinetattentionguidedfeatureintegrationnetworkforrgbdsaliencydetection AT shuguangzhao afinetattentionguidedfeatureintegrationnetworkforrgbdsaliencydetection AT ruisun afinetattentionguidedfeatureintegrationnetworkforrgbdsaliencydetection AT xiaodongchai afinetattentionguidedfeatureintegrationnetworkforrgbdsaliencydetection AT shubinzheng afinetattentionguidedfeatureintegrationnetworkforrgbdsaliencydetection AT xingjiechen afinetattentionguidedfeatureintegrationnetworkforrgbdsaliencydetection AT zhaominlv afinetattentionguidedfeatureintegrationnetworkforrgbdsaliencydetection |
_version_ |
1714682993693425664 |