Improving RGBD Saliency Detection Using Progressive Region Classification and Saliency Fusion

This paper proposes an effective method to improve the saliency detection performance of existing RGBD (RGB image with Depth map) saliency models. First, a progressive region classification method is proposed to collect training samples at coarse scale and fine scale via the inter-region hierarchica...

Full description

Bibliographic Details
Main Authors: Huan Du, Zhi Liu, Hangke Song, Lin Mei, Zheng Xu
Format: Article
Language:English
Published: IEEE 2016-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/7762806/
id doaj-c2e72adabbe74c1da3d4611afc172aef
record_format Article
spelling doaj-c2e72adabbe74c1da3d4611afc172aef2021-03-29T19:46:31ZengIEEEIEEE Access2169-35362016-01-0148987899410.1109/ACCESS.2016.26327247762806Improving RGBD Saliency Detection Using Progressive Region Classification and Saliency FusionHuan Du0Zhi Liu1https://orcid.org/0000-0002-8428-1131Hangke Song2Lin Mei3Zheng Xu4School of Communication and Information Engineering, Shanghai University, Shanghai, ChinaSchool of Communication and Information Engineering, Shanghai University, Shanghai, ChinaSchool of Communication and Information Engineering, Shanghai University, Shanghai, ChinaTechnology Research and Development Center for the Internet of Things, The Third Research Institute of the Ministry of Public Security, Shanghai, ChinaTechnology Research and Development Center for the Internet of Things, The Third Research Institute of the Ministry of Public Security, Shanghai, ChinaThis paper proposes an effective method to improve the saliency detection performance of existing RGBD (RGB image with Depth map) saliency models. First, a progressive region classification method is proposed to collect training samples at coarse scale and fine scale via the inter-region hierarchical structure. A random forest regressor is then learned to predict the coarse saliency map and fine saliency map, respectively. Finally, the saliency maps at the two scales are integrated into the final saliency map under the constraint of the inter-region hierarchical structure. Experimental results on a RGBD image data set and a stereoscopic image data set with comparisons with the state-of-the-art saliency models validate that the proposed method consistently improves the saliency detection performance of various saliency models.https://ieeexplore.ieee.org/document/7762806/RGBD saliency detectionprogressive region classificationinter-region hierarchical structurerandom forest regressorsaliency fusion
collection DOAJ
language English
format Article
sources DOAJ
author Huan Du
Zhi Liu
Hangke Song
Lin Mei
Zheng Xu
spellingShingle Huan Du
Zhi Liu
Hangke Song
Lin Mei
Zheng Xu
Improving RGBD Saliency Detection Using Progressive Region Classification and Saliency Fusion
IEEE Access
RGBD saliency detection
progressive region classification
inter-region hierarchical structure
random forest regressor
saliency fusion
author_facet Huan Du
Zhi Liu
Hangke Song
Lin Mei
Zheng Xu
author_sort Huan Du
title Improving RGBD Saliency Detection Using Progressive Region Classification and Saliency Fusion
title_short Improving RGBD Saliency Detection Using Progressive Region Classification and Saliency Fusion
title_full Improving RGBD Saliency Detection Using Progressive Region Classification and Saliency Fusion
title_fullStr Improving RGBD Saliency Detection Using Progressive Region Classification and Saliency Fusion
title_full_unstemmed Improving RGBD Saliency Detection Using Progressive Region Classification and Saliency Fusion
title_sort improving rgbd saliency detection using progressive region classification and saliency fusion
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2016-01-01
description This paper proposes an effective method to improve the saliency detection performance of existing RGBD (RGB image with Depth map) saliency models. First, a progressive region classification method is proposed to collect training samples at coarse scale and fine scale via the inter-region hierarchical structure. A random forest regressor is then learned to predict the coarse saliency map and fine saliency map, respectively. Finally, the saliency maps at the two scales are integrated into the final saliency map under the constraint of the inter-region hierarchical structure. Experimental results on a RGBD image data set and a stereoscopic image data set with comparisons with the state-of-the-art saliency models validate that the proposed method consistently improves the saliency detection performance of various saliency models.
topic RGBD saliency detection
progressive region classification
inter-region hierarchical structure
random forest regressor
saliency fusion
url https://ieeexplore.ieee.org/document/7762806/
work_keys_str_mv AT huandu improvingrgbdsaliencydetectionusingprogressiveregionclassificationandsaliencyfusion
AT zhiliu improvingrgbdsaliencydetectionusingprogressiveregionclassificationandsaliencyfusion
AT hangkesong improvingrgbdsaliencydetectionusingprogressiveregionclassificationandsaliencyfusion
AT linmei improvingrgbdsaliencydetectionusingprogressiveregionclassificationandsaliencyfusion
AT zhengxu improvingrgbdsaliencydetectionusingprogressiveregionclassificationandsaliencyfusion
_version_ 1724195765857812480