Salient Object Detection from Multi-spectral Remote Sensing Images with Deep Residual Network

This paper focuses on intelligent photogrammetry deep learning:deep residual method.Salient object detection aims at identifying the visually interesting object regions that are consistent with human perception.Multispectral remote sensing images provide rich radiometric information in revealing the...

Full description

Bibliographic Details
Main Authors: DAI Yuchao, ZHANG Jing, Fatih PORIKLI, HE Mingyi
Format: Article
Language:zho
Published: Surveying and Mapping Press 2018-06-01
Series:Acta Geodaetica et Cartographica Sinica
Subjects:
Online Access:http://html.rhhz.net/CHXB/html/2018-6-873.htm
id doaj-cd081422168b4d79a9849a49e05ceca8
record_format Article
spelling doaj-cd081422168b4d79a9849a49e05ceca82020-11-24T22:18:07ZzhoSurveying and Mapping PressActa Geodaetica et Cartographica Sinica1001-15951001-15952018-06-0147687388110.11947/j.AGCS.2018.201706332018060633Salient Object Detection from Multi-spectral Remote Sensing Images with Deep Residual NetworkDAI Yuchao0ZHANG Jing1Fatih PORIKLI2HE Mingyi3School of Electronics and Information, Northwestern Polytechnical University, Xi'an 710129, ChinaSchool of Electronics and Information, Northwestern Polytechnical University, Xi'an 710129, ChinaResearch School of Engineering, Australian National University, Canberra 2601, AustraliaSchool of Electronics and Information, Northwestern Polytechnical University, Xi'an 710129, ChinaThis paper focuses on intelligent photogrammetry deep learning:deep residual method.Salient object detection aims at identifying the visually interesting object regions that are consistent with human perception.Multispectral remote sensing images provide rich radiometric information in revealing the physical properties of the observed objects,therefore promise a great potential in salient object detection tasks.Conventional salient object detection methods often employ handcrafted features to predict saliency by evaluating the pixel-wise or superpixel-wise similarity.With the recent emergence of deep learning based approaches,in particular,fully convolutional neural networks,there has been profound progress in visual saliency detection.However,this success has not been extended to multispectral remote sensing images,and existing multispectral salient object detection methods are still mainly based on handcrafted features,essentially due to the difficulties in image acquisition and labeling.In this paper,we propose a novel deep residual network based on a top-down model,which is trained in an end-to-end manner to tackle the above issues in multispectral salient object detection.Our model effectively exploits the saliency cues at different levels of the deep residual network.To overcome the limited availability of remote sensing images in training of our deep residual network,we also introduce a new spectral image reconstruction model that can generate multispectral images from RGB images.Our extensive experimental evaluations using both multispectral and RGB salient object detection datasets demonstrate a significant performance improvement of more than 10% compared with the state-of-the-art methods.http://html.rhhz.net/CHXB/html/2018-6-873.htmdeep residual networksalient object detectionspectral super-resolutiontop-down modelremote sensing image processing
collection DOAJ
language zho
format Article
sources DOAJ
author DAI Yuchao
ZHANG Jing
Fatih PORIKLI
HE Mingyi
spellingShingle DAI Yuchao
ZHANG Jing
Fatih PORIKLI
HE Mingyi
Salient Object Detection from Multi-spectral Remote Sensing Images with Deep Residual Network
Acta Geodaetica et Cartographica Sinica
deep residual network
salient object detection
spectral super-resolution
top-down model
remote sensing image processing
author_facet DAI Yuchao
ZHANG Jing
Fatih PORIKLI
HE Mingyi
author_sort DAI Yuchao
title Salient Object Detection from Multi-spectral Remote Sensing Images with Deep Residual Network
title_short Salient Object Detection from Multi-spectral Remote Sensing Images with Deep Residual Network
title_full Salient Object Detection from Multi-spectral Remote Sensing Images with Deep Residual Network
title_fullStr Salient Object Detection from Multi-spectral Remote Sensing Images with Deep Residual Network
title_full_unstemmed Salient Object Detection from Multi-spectral Remote Sensing Images with Deep Residual Network
title_sort salient object detection from multi-spectral remote sensing images with deep residual network
publisher Surveying and Mapping Press
series Acta Geodaetica et Cartographica Sinica
issn 1001-1595
1001-1595
publishDate 2018-06-01
description This paper focuses on intelligent photogrammetry deep learning:deep residual method.Salient object detection aims at identifying the visually interesting object regions that are consistent with human perception.Multispectral remote sensing images provide rich radiometric information in revealing the physical properties of the observed objects,therefore promise a great potential in salient object detection tasks.Conventional salient object detection methods often employ handcrafted features to predict saliency by evaluating the pixel-wise or superpixel-wise similarity.With the recent emergence of deep learning based approaches,in particular,fully convolutional neural networks,there has been profound progress in visual saliency detection.However,this success has not been extended to multispectral remote sensing images,and existing multispectral salient object detection methods are still mainly based on handcrafted features,essentially due to the difficulties in image acquisition and labeling.In this paper,we propose a novel deep residual network based on a top-down model,which is trained in an end-to-end manner to tackle the above issues in multispectral salient object detection.Our model effectively exploits the saliency cues at different levels of the deep residual network.To overcome the limited availability of remote sensing images in training of our deep residual network,we also introduce a new spectral image reconstruction model that can generate multispectral images from RGB images.Our extensive experimental evaluations using both multispectral and RGB salient object detection datasets demonstrate a significant performance improvement of more than 10% compared with the state-of-the-art methods.
topic deep residual network
salient object detection
spectral super-resolution
top-down model
remote sensing image processing
url http://html.rhhz.net/CHXB/html/2018-6-873.htm
work_keys_str_mv AT daiyuchao salientobjectdetectionfrommultispectralremotesensingimageswithdeepresidualnetwork
AT zhangjing salientobjectdetectionfrommultispectralremotesensingimageswithdeepresidualnetwork
AT fatihporikli salientobjectdetectionfrommultispectralremotesensingimageswithdeepresidualnetwork
AT hemingyi salientobjectdetectionfrommultispectralremotesensingimageswithdeepresidualnetwork
_version_ 1725783136526139392