AFI-Net: Attention-Guided Feature Integration Network for RGBD Saliency Detection

This article proposes an innovative RGBD saliency model, that is, attention-guided feature integration network, which can extract and fuse features and perform saliency inference. Specifically, the model first extracts multimodal and level deep features. Then, a series of attention modules are deplo...

Full description

Bibliographic Details
Main Authors: Liming Li, Shuguang Zhao, Rui Sun, Xiaodong Chai, Shubin Zheng, Xingjie Chen, Zhaomin Lv
Format: Article
Language:English
Published: Hindawi Limited 2021-01-01
Series:Computational Intelligence and Neuroscience
Online Access:http://dx.doi.org/10.1155/2021/8861446
id doaj-89de6cd6b1bc490495a8d770c277d16b
record_format Article
spelling doaj-89de6cd6b1bc490495a8d770c277d16b2021-04-12T01:24:21ZengHindawi LimitedComputational Intelligence and Neuroscience1687-52732021-01-01202110.1155/2021/8861446AFI-Net: Attention-Guided Feature Integration Network for RGBD Saliency DetectionLiming Li0Shuguang Zhao1Rui Sun2Xiaodong Chai3Shubin Zheng4Xingjie Chen5Zhaomin Lv6School of Information Science and TechnologySchool of Information Science and TechnologySchool of Urban Railway TransportationSchool of Urban Railway TransportationSchool of Urban Railway TransportationSchool of Urban Railway TransportationSchool of Urban Railway TransportationThis article proposes an innovative RGBD saliency model, that is, attention-guided feature integration network, which can extract and fuse features and perform saliency inference. Specifically, the model first extracts multimodal and level deep features. Then, a series of attention modules are deployed to the multilevel RGB and depth features, yielding enhanced deep features. Next, the enhanced multimodal deep features are hierarchically fused. Lastly, the RGB and depth boundary features, that is, low-level spatial details, are added to the integrated feature to perform saliency inference. The key points of the AFI-Net are the attention-guided feature enhancement and the boundary-aware saliency inference, where the attention module indicates salient objects coarsely, and the boundary information is used to equip the deep feature with more spatial details. Therefore, salient objects are well characterized, that is, well highlighted. The comprehensive experiments on five challenging public RGBD datasets clearly exhibit the superiority and effectiveness of the proposed AFI-Net.http://dx.doi.org/10.1155/2021/8861446
collection DOAJ
language English
format Article
sources DOAJ
author Liming Li
Shuguang Zhao
Rui Sun
Xiaodong Chai
Shubin Zheng
Xingjie Chen
Zhaomin Lv
spellingShingle Liming Li
Shuguang Zhao
Rui Sun
Xiaodong Chai
Shubin Zheng
Xingjie Chen
Zhaomin Lv
AFI-Net: Attention-Guided Feature Integration Network for RGBD Saliency Detection
Computational Intelligence and Neuroscience
author_facet Liming Li
Shuguang Zhao
Rui Sun
Xiaodong Chai
Shubin Zheng
Xingjie Chen
Zhaomin Lv
author_sort Liming Li
title AFI-Net: Attention-Guided Feature Integration Network for RGBD Saliency Detection
title_short AFI-Net: Attention-Guided Feature Integration Network for RGBD Saliency Detection
title_full AFI-Net: Attention-Guided Feature Integration Network for RGBD Saliency Detection
title_fullStr AFI-Net: Attention-Guided Feature Integration Network for RGBD Saliency Detection
title_full_unstemmed AFI-Net: Attention-Guided Feature Integration Network for RGBD Saliency Detection
title_sort afi-net: attention-guided feature integration network for rgbd saliency detection
publisher Hindawi Limited
series Computational Intelligence and Neuroscience
issn 1687-5273
publishDate 2021-01-01
description This article proposes an innovative RGBD saliency model, that is, attention-guided feature integration network, which can extract and fuse features and perform saliency inference. Specifically, the model first extracts multimodal and level deep features. Then, a series of attention modules are deployed to the multilevel RGB and depth features, yielding enhanced deep features. Next, the enhanced multimodal deep features are hierarchically fused. Lastly, the RGB and depth boundary features, that is, low-level spatial details, are added to the integrated feature to perform saliency inference. The key points of the AFI-Net are the attention-guided feature enhancement and the boundary-aware saliency inference, where the attention module indicates salient objects coarsely, and the boundary information is used to equip the deep feature with more spatial details. Therefore, salient objects are well characterized, that is, well highlighted. The comprehensive experiments on five challenging public RGBD datasets clearly exhibit the superiority and effectiveness of the proposed AFI-Net.
url http://dx.doi.org/10.1155/2021/8861446
work_keys_str_mv AT limingli afinetattentionguidedfeatureintegrationnetworkforrgbdsaliencydetection
AT shuguangzhao afinetattentionguidedfeatureintegrationnetworkforrgbdsaliencydetection
AT ruisun afinetattentionguidedfeatureintegrationnetworkforrgbdsaliencydetection
AT xiaodongchai afinetattentionguidedfeatureintegrationnetworkforrgbdsaliencydetection
AT shubinzheng afinetattentionguidedfeatureintegrationnetworkforrgbdsaliencydetection
AT xingjiechen afinetattentionguidedfeatureintegrationnetworkforrgbdsaliencydetection
AT zhaominlv afinetattentionguidedfeatureintegrationnetworkforrgbdsaliencydetection
_version_ 1714682993693425664